00000001:02000400:2.0F:1790784208.897953:0:2954:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg632-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1790784220.886561:0:3157:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg632-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1790784222.986864:0:3219:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 699 MB/s 00000001:01000000:2.0:1790784223.237645:0:3219:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 617 MB/s 00000001:01000000:1.0:1790784223.487445:0:3219:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4307 MB/s 00000020:02000000:2.0:1790784224.213369:0:3248:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_40_ge80375b 00000400:02000000:1.0:1790784225.219750:0:3263:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.206.132@tcp [8/256/0/180] 00008000:02000000:0.0F:1790784228.568099:0:3413:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1790784280.902900:0:5225:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg632-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1790784291.208272:0:5799:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790784291.208279:0:5799:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1790784291.209053:0:5799:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000ea40fda1 00000080:02000400:2.0:1790784291.209067:0:5799:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1790784291.239111:0:5799:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1790784291.239124:0:5799:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1790784291.248125:0:5799:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000c5eec4ba) 00000020:00000080:2.0:1790784291.248148:0:5799:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790784291.285069:0:5799:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1790784291.285440:0:5799:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1790784291.327314:0:5799:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1790784291.327356:0:5799:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790784291.327914:0:5799:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1790784291.328933:0:5799:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790784291.329001:0:5799:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1790784291.329346:0:5799:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1790784291.329354:0:5799:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790784291.329364:0:5799:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2c3a1e2a079d3351 00000020:01000004:2.0:1790784291.329371:0:5799:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1790784291.329933:0:5799:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1790784291.329940:0:5799:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ea40fda1 from MGS 00000020:01000004:2.0:1790784291.329944:0:5799:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1790784291.329954:0:5799:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000005593a63) 00000020:00000080:2.0:1790784291.330132:0:5799:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1790784291.330188:0:5799:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ea40fda1 from MGS, refs=2 00080000:01000000:2.0:1790784291.330193:0:5799:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790784291.330199:0:5799:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2c3a1e2a079d335f 00000100:00100000:2.0:1790784291.330306:0:5799:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1790784291.330457:0:5799:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1790784291.330463:0:5799:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1790784291.332548:0:5799:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1790784291.332560:0:5799:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1790784291.333331:0:5799:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790784291.333530:0:5799:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1790784291.333536:0:5799:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1790784291.337146:0:5799:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1790784291.337163:0:5799:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1790784291.338280:0:5799:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1790784291.338291:0:5799:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1790784291.339755:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784291.339768:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784291.339770:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784291.340307:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784291.340310:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784291.340312:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784291.343042:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784291.343092:0:5799:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00000001:01000000:2.0:1790784291.592419:0:5799:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1883 MB/s 00000001:01000000:3.0:1790784291.843420:0:5799:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2883 MB/s 00000001:01000000:3.0:1790784292.092411:0:5799:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 375 MB/s 00000001:01000000:2.0:1790784292.344858:0:5799:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 543 MB/s 00010000:00010000:1.0:1790784292.346736:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1790784292.392231:0:5799:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1790784292.411327:0:5799:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1790784292.411345:0:5799:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1790784292.411348:0:5799:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1790784292.413397:0:5809:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1790784292.413473:0:5799:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1790784292.413523:0:5799:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1790784292.413754:0:5799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1790784292.413779:0:5799:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1790784292.414137:0:5799:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790784292.414356:0:5799:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1790784292.414391:0:5799:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1790784292.415452:0:5799:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1790784292.415460:0:5799:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1790784292.415935:0:5799:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1790784292.415943:0:5799:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1790784292.423663:0:5799:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1790784292.423684:0:5799:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.132@tcp' 00000020:01000004:0.0:1790784292.423697:0:5799:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1790784292.423818:0:5799:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.132@tcp (typ=mgc) 00000020:00000080:0.0:1790784292.423842:0:5799:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.132@tcp (000000004b19bacb) 00000020:00000080:0.0:1790784292.423859:0:5799:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1790784292.423988:0:5799:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000087ac8f22@MGC192.168.206.132@tcp: add connection 192.168.206.132@tcp at head 00010000:00010000:0.0:1790784292.424135:0:5799:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.132@tcp-0 is initialized 00000040:01000000:0.0:1790784292.424141:0:5799:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.132@tcp ctxt 1 is initialized 10000000:01000000:3.0:1790784292.428848:0:5815:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000100:00080000:2.0:1790784292.429013:0:5814:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1790784292.429221:0:5799:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.132@tcp (uuid d3e7b7e5-0721-4246-a3a0-5d40e18144b6) 00000020:00000080:0.0:1790784292.429244:0:5799:0:(genops.c:1384:class_connect()) connect: client d3e7b7e5-0721-4246-a3a0-5d40e18144b6, cookie 0x2c3a1e2a079d336d 00000100:00080000:0.0:1790784292.429255:0:5799:0:(import.c:545:import_select_connection()) MGC192.168.206.132@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790784292.429263:0:5799:0:(import.c:666:import_select_connection()) MGC192.168.206.132@tcp: import 0000000087ac8f22 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:0.0:1790784292.429301:0:5799:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000004288f91 x1877773359513728/t0(0) o250->MGC192.168.206.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790784292.429439:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004288f91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3278:1877773359513728:0@lo:250: 00000100:00100000:2.0:1790784292.429521:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790784292.429607:0:5799:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d3e7b7e5-0721-4246-a3a0-5d40e18144b6->MGS 00000020:01000004:0.0:1790784292.429633:0:5799:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1790784292.429638:0:5799:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1790784292.429650:0:5799:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000a11b97fc) 00000020:00000080:0.0:1790784292.429664:0:5799:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1790784292.432407:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359513728 00000100:00100000:3.0:1790784292.432421:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359513728 00000100:00100000:3.0:1790784292.432467:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790784292.432476:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e5d2ec1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3278:x1877773359513728:12345-0@lo:250: 00010000:00080000:3.0:1790784292.432502:0:5810:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from d3e7b7e5-0721-4246-a3a0-5d40e18144b6@0@lo t0 exp 0000000000000000 cur 126 last 0 00000020:00000080:3.0:1790784292.432529:0:5810:0:(genops.c:1384:class_connect()) connect: client d3e7b7e5-0721-4246-a3a0-5d40e18144b6, cookie 0x2c3a1e2a079d337b 00000100:00080000:3.0:1790784292.432661:0:5810:0:(import.c:65:import_set_state_nolock()) 000000004f1fb76d : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790784292.441861:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e5d2ec1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+5:3278:x1877773359513728:12345-0@lo:250: Request processed in 9379us (12335us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784292.441875:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790784292.442400:0:3278:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.132@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1790784292.442411:0:3278:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.206.132@tcp: connect to target with instance 0 00000100:00080000:2.0:1790784292.442418:0:3278:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.206.132@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1790784292.442422:0:3278:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1790784292.442426:0:3278:0:(import.c:65:import_set_state_nolock()) 0000000087ac8f22 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1790784292.442429:0:3278:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1790784292.442439:0:3278:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1790784292.442445:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004288f91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3278:1877773359513728:0@lo:250: 00000100:00100000:0.0:1790784292.450473:0:5799:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790784292.450660:0:5799:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1790784292.450666:0:5799:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1790784292.454947:0:5799:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1790784292.454970:0:5799:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1790784292.458627:0:5799:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1790784292.458641:0:5799:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1790784292.459652:0:5799:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790784292.459843:0:5799:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1790784292.459849:0:5799:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1790784292.462948:0:5799:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1790784292.462963:0:5799:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1790784292.533612:0:5799:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790784292.533815:0:5799:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1790784292.533821:0:5799:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1790784292.537104:0:5799:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1790784292.537122:0:5799:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1790784292.538575:0:5799:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790784292.539274:0:5799:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790784292.539281:0:5799:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1790784292.545996:0:5799:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790784292.546008:0:5799:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1790784292.546715:0:5799:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790784292.546899:0:5799:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790784292.546904:0:5799:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1790784292.547636:0:5799:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790784292.547651:0:5799:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1790784292.548525:0:5799:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790784292.550207:0:5799:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790784292.550354:0:5799:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1790784292.554177:0:5799:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790784292.554188:0:5799:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1790784292.611304:0:5799:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790784292.611542:0:5799:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1790784292.611548:0:5799:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1790784292.621365:0:5799:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790784292.621420:0:5799:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1790784292.626966:0:5799:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1790784292.626984:0:5799:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1790784292.628050:0:5799:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1790784292.628074:0:5799:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1790784292.628079:0:5799:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.132@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1790784292.628199:0:5799:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.132@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790784292.628237:0:5799:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.132@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1790784292.628241:0:5799:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790784292.628243:0:5799:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790784292.628244:0:5799:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790784292.628245:0:5799:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790784292.628246:0:5799:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790784292.628247:0:5799:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790784292.628248:0:5799:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790784292.628249:0:5799:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790784292.628250:0:5799:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790784292.628251:0:5799:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790784292.628252:0:5799:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790784292.628253:0:5799:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790784292.628255:0:5799:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1790784292.628257:0:5799:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790784292.628258:0:5799:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790784292.628259:0:5799:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790784292.628260:0:5799:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790784292.628261:0:5799:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790784292.628262:0:5799:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790784292.628262:0:5799:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790784292.628263:0:5799:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790784292.628268:0:5799:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790784292.628269:0:5799:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790784292.628270:0:5799:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790784292.628271:0:5799:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790784292.628294:0:5799:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1790784292.628309:0:5799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a8451e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5799:1877773359513856:0@lo:253: 00000100:00100000:0.0:1790784292.628661:0:5799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784292.628935:0:5799:0:(client.c:2716:ptlrpc_set_wait()) set 0000000019f3ffec going to sleep for 11 seconds 00000100:00100000:2.0:1790784292.634964:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359513856 00000100:00100000:2.0:1790784292.634988:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359513856 00000100:00100000:2.0:1790784292.635049:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790784292.635058:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000034e65542 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+5:5799:x1877773359513856:12345-0@lo:253: 20000000:01000000:2.0:1790784292.635104:0:5812:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790784292.635107:0:5812:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1790784292.635582:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1790784292.635812:0:5812:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1790784292.636153:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790784292.637964:0:5835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1790784292.638439:0:5812:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790784292.638444:0:5812:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1790784292.638449:0:5812:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1790784292.638452:0:5812:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1790784292.638467:0:5812:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1790784292.638939:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790784292.639240:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1790784292.639252:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1790784292.639298:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1790784292.639348:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1790784292.640936:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1790784292.641219:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1790784292.641229:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1790784292.641292:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1790784292.641300:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1790784292.641332:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1790784292.641352:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1790784292.642517:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1790784292.642880:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1790784292.642932:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1790784292.642937:0:5812:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1790784292.642952:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790784292.644136:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1790784292.644155:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1790784292.644203:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1790784292.644238:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1790784292.644284:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1790784292.644298:0:5812:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1790784292.644424:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1790784292.644433:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1790784292.644481:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1790784292.644519:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1790784292.644570:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1790784292.644582:0:5812:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1790784292.644664:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1790784292.644673:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1790784292.645607:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1790784292.645658:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1790784292.646119:0:5812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1790784292.646166:0:5812:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1790784292.646224:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1790784292.649324:0:5836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1790784292.650099:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1790784292.650127:0:5812:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.132@tcp for mdt 20000000:01000000:3.0:1790784292.650129:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.132@tcp (null) (null) (null) 00000040:00080000:3.0:1790784292.650168:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1790784292.650177:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1790784292.650210:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1790784292.650218:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.132@tcp (null) (null) 00000040:00080000:3.0:1790784292.650301:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1790784292.650313:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1790784292.650348:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1790784292.650424:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1790784292.650508:0:5812:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1790784292.650511:0:5812:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1790784292.650515:0:5812:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1790784292.650525:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1790784292.650527:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1790784292.650552:0:5812:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1790784292.650555:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1790784292.651091:0:5837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1790784292.651312:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1790784292.651353:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1790784292.651425:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1790784292.651439:0:5812:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1790784292.651441:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1790784292.652447:0:5838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1790784292.652662:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1790784292.652727:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1790784292.652790:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:3.0:1790784292.652805:0:5812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790784292.652807:0:5812:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1790784292.652811:0:5812:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1790784292.652814:0:5812:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1790784292.652817:0:5812:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1790784292.652823:0:5812:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1790784292.653401:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1790784292.653568:0:5812:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1790784292.667154:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1790784292.667223:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1790784292.667311:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1790784292.667337:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1790784292.667364:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a4f573f4/0x2c3a1e2a079d3382 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784292.667406:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a4f573f4/0x2c3a1e2a079d3382 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784292.667422:0:5812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a4f573f4/0x2c3a1e2a079d3382 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784292.667428:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a4f573f4/0x2c3a1e2a079d3382 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784292.667447:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a4f573f4/0x2c3a1e2a079d3382 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784292.667454:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a4f573f4/0x2c3a1e2a079d3382 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784292.667460:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a4f573f4 already unused, calling callback (000000005eb8f29d) 00010000:00010000:2.0:1790784292.667465:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a4f573f4/0x2c3a1e2a079d3382 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784292.667473:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a4f573f4/0x2c3a1e2a079d3382 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784292.667498:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a4f573f4/0x2c3a1e2a079d3382 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784292.667526:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a4f573f4/0x2c3a1e2a079d3382 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784292.667532:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a4f573f4/0x2c3a1e2a079d3382 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790784292.667552:0:5812:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1790784293.082487:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000034e65542 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+5:5799:x1877773359513856:12345-0@lo:253: Request processed in 447418us (454103us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784293.082508:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790784293.082644:0:5799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a8451e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5799:1877773359513856:0@lo:253: 10000000:01000000:1.0:1790784293.082665:0:5799:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790784293.082669:0:5799:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790784293.082671:0:5799:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790784293.082673:0:5799:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790784293.082674:0:5799:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1790784293.082676:0:5799:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790784293.082677:0:5799:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790784293.082678:0:5799:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790784293.082680:0:5799:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790784293.082712:0:5799:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1790784293.082713:0:5799:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790784293.082715:0:5799:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790784293.082745:0:5799:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ea40fda1 from lustre-MDT0000 10000000:01000000:1.0:1790784293.082778:0:5799:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1790784293.082781:0:5799:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790784293.082785:0:5799:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9459057499c0 10000000:01000000:1.0:1790784293.082790:0:5799:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790784293.082799:0:5799:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9459057499c0 from 1 10000000:01000000:1.0:1790784293.082802:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790784293.082867:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: 00000000c2b72e10/0x2c3a1e2a079d3389 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784293.082879:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: 00000000c2b72e10/0x2c3a1e2a079d3389 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784293.082888:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: 00000000c2b72e10/0x2c3a1e2a079d3389 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784293.082908:0:5799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000e94f4c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5799:1877773359513984:0@lo:101: 00000100:00100000:1.0:1790784293.082973:0:5799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784293.083039:0:5799:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017cd429a going to sleep for 11 seconds 00000100:00100000:3.0:1790784293.083195:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359513984 00000100:00100000:3.0:1790784293.083203:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359513984 00000100:00100000:3.0:1790784293.083315:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790784293.083325:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000bfe2fc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+5:5799:x1877773359513984:12345-0@lo:101: 00010000:00010000:3.0:1790784293.083341:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784293.083358:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ac01b9e2/0x2c3a1e2a079d3390 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d3389 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784293.083417:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ac01b9e2/0x2c3a1e2a079d3390 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3389 expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784293.083435:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ac01b9e2/0x2c3a1e2a079d3390 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3389 expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784293.083444:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ac01b9e2, rc 0) 00000100:00100000:3.0:1790784293.083480:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000bfe2fc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+6:5799:x1877773359513984:12345-0@lo:101: Request processed in 157us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784293.083486:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790784293.084125:0:5799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000e94f4c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5799:1877773359513984:0@lo:101: 00010000:00010000:1.0:1790784293.084144:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: 00000000c2b72e10/0x2c3a1e2a079d3389 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3390 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784293.084154:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: 00000000c2b72e10/0x2c3a1e2a079d3389 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d3390 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784293.084225:0:5799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000e94f4c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5799:1877773359514112:0@lo:501: 00000100:00100000:1.0:1790784293.084317:0:5799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784293.084368:0:5799:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017cd429a going to sleep for 11 seconds 00000100:00100000:3.0:1790784293.084526:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359514112 00000100:00100000:3.0:1790784293.084533:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359514112 00000100:00100000:3.0:1790784293.084574:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790784293.084580:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000087c85722 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+6:5799:x1877773359514112:12345-0@lo:501: 00000100:00100000:3.0:1790784293.084953:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000087c85722 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+6:5799:x1877773359514112:12345-0@lo:501: Request processed in 373us (637us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790784293.084961:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790784293.085115:0:5799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000e94f4c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5799:1877773359514112:0@lo:501: 10000000:01000000:2.0:1790784293.085151:0:5799:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790784293.085201:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: 00000000c2b72e10/0x2c3a1e2a079d3389 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3390 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784293.085211:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: 00000000c2b72e10/0x2c3a1e2a079d3389 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3390 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790784293.085220:0:5799:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff945905fd5000 10000000:01000000:2.0:1790784293.085226:0:5799:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790784293.085230:0:5799:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff945905fd5000 10000000:01000000:2.0:1790784293.085233:0:5799:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1790784293.085246:0:5799:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff945905fd5000 from 1 10000000:01000000:2.0:1790784293.085249:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1790784293.085289:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: 00000000a4f573f4/0x2c3a1e2a079d3397 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784293.085297:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: 00000000a4f573f4/0x2c3a1e2a079d3397 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784293.085306:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: 00000000a4f573f4/0x2c3a1e2a079d3397 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784293.085328:0:5799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000002f832ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5799:1877773359514240:0@lo:101: 00000100:00100000:2.0:1790784293.085361:0:5799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784293.085411:0:5799:0:(client.c:2716:ptlrpc_set_wait()) set 0000000063a36cfc going to sleep for 11 seconds 00000100:00100000:0.0:1790784293.085508:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359514240 00000100:00100000:0.0:1790784293.085513:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359514240 00000100:00100000:0.0:1790784293.085548:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790784293.085555:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000399016c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+6:5799:x1877773359514240:12345-0@lo:101: 00010000:00010000:0.0:1790784293.085565:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784293.085579:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009cb92356/0x2c3a1e2a079d339e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d3397 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784293.085598:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009cb92356/0x2c3a1e2a079d339e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3397 expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784293.085607:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009cb92356/0x2c3a1e2a079d339e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3397 expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784293.085614:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009cb92356, rc 0) 00000100:00100000:0.0:1790784293.085660:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000399016c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+7:5799:x1877773359514240:12345-0@lo:101: Request processed in 106us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784293.085666:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790784293.085750:0:5799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000002f832ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5799:1877773359514240:0@lo:101: 00010000:00010000:1.0:1790784293.085762:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: 00000000a4f573f4/0x2c3a1e2a079d3397 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d339e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784293.085770:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: 00000000a4f573f4/0x2c3a1e2a079d3397 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d339e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790784293.085783:0:5799:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1790784293.085994:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: 00000000a4f573f4/0x2c3a1e2a079d3397 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d339e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784293.086003:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: 00000000a4f573f4/0x2c3a1e2a079d3397 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d339e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790784293.086010:0:5799:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790784293.086014:0:5799:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790784293.086019:0:5799:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff945905fd5000 10000000:01000000:1.0:1790784293.086022:0:5799:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1790784293.086025:0:5799:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1790784293.086027:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790784293.086042:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: 00000000912a179e/0x2c3a1e2a079d33a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784293.086049:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: 00000000912a179e/0x2c3a1e2a079d33a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784293.086056:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: 00000000912a179e/0x2c3a1e2a079d33a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784293.086067:0:5799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000079a34d15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5799:1877773359514368:0@lo:101: 00000100:00100000:1.0:1790784293.086100:0:5799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784293.086124:0:5799:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c21a9d3b going to sleep for 11 seconds 00000100:00100000:2.0:1790784293.086174:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359514368 00000100:00100000:2.0:1790784293.086179:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359514368 00000100:00100000:2.0:1790784293.086208:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790784293.086214:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ec511074 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+7:5799:x1877773359514368:12345-0@lo:101: 00010000:00010000:2.0:1790784293.086222:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784293.086230:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000313a33bb/0x2c3a1e2a079d33ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d33a5 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784293.086345:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000313a33bb/0x2c3a1e2a079d33ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d33a5 expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784293.086353:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000313a33bb/0x2c3a1e2a079d33ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d33a5 expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784293.086360:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000313a33bb, rc 0) 00000100:00100000:2.0:1790784293.086416:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ec511074 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+8:5799:x1877773359514368:12345-0@lo:101: Request processed in 202us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784293.086422:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790784293.086488:0:5799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000079a34d15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5799:1877773359514368:0@lo:101: 00010000:00010000:1.0:1790784293.086498:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: 00000000912a179e/0x2c3a1e2a079d33a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d33ac expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784293.086505:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: 00000000912a179e/0x2c3a1e2a079d33a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d33ac expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784293.086552:0:5799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000079a34d15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5799:1877773359514496:0@lo:501: 00000100:00100000:1.0:1790784293.086573:0:5799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784293.086600:0:5799:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c21a9d3b going to sleep for 11 seconds 00000100:00100000:2.0:1790784293.086692:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359514496 00000100:00100000:2.0:1790784293.086696:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359514496 00000100:00100000:0.0:1790784293.086799:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790784293.086807:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000079507e82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+8:5799:x1877773359514496:12345-0@lo:501: 00000100:00100000:0.0:1790784293.087061:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000079507e82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+9:5799:x1877773359514496:12345-0@lo:501: Request processed in 255us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784293.087073:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790784293.087144:0:5799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000079a34d15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5799:1877773359514496:0@lo:501: 00000100:00100000:1.0:1790784293.087170:0:5799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000079a34d15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5799:1877773359514624:0@lo:503: 00000100:00100000:1.0:1790784293.087205:0:5799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784293.087228:0:5799:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c21a9d3b going to sleep for 11 seconds 00000100:00100000:0.0:1790784293.087371:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359514624 00000100:00100000:0.0:1790784293.087396:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359514624 00000100:00100000:0.0:1790784293.087427:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790784293.087434:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ff772e7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+9:5799:x1877773359514624:12345-0@lo:503: 00000100:00100000:0.0:1790784293.087594:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ff772e7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+9:5799:x1877773359514624:12345-0@lo:503: Request processed in 161us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784293.087600:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790784293.087695:0:5799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000079a34d15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5799:1877773359514624:0@lo:503: 00000100:00100000:1.0:1790784293.088439:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000079a34d15 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5842:1877773359514752:0@lo:502: 00000100:00100000:1.0:1790784293.088499:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784293.088543:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 000000005cc5814f going to sleep for 11 seconds 00000100:00100000:0.0:1790784293.088609:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359514752 00000100:00100000:0.0:1790784293.088616:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359514752 00000100:00100000:0.0:1790784293.088660:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790784293.088668:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000077e8441b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+9:5842:x1877773359514752:12345-0@lo:502: 00000100:00100000:0.0:1790784293.089044:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000077e8441b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+9:5842:x1877773359514752:12345-0@lo:502: Request processed in 376us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784293.089053:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790784293.090591:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000079a34d15 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5842:1877773359514752:0@lo:502: 00000020:01000000:2.0:1790784293.090652:0:5842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790784293.090669:0:5842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784293.090672:0:5842:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1790784293.090700:0:5842:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1790784293.090704:0:5842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790784293.090794:0:5842:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000005bfbed74) 00000020:00000080:2.0:1790784293.090821:0:5842:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1790784293.090829:0:5842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1790784293.090932:0:5842:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1790784293.090939:0:5842:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2c3a1e2a079d33ba 00000020:00000080:2.0:1790784293.091414:0:5842:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1790784293.091421:0:5842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790784293.091426:0:5842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784293.091427:0:5842:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1790784293.091431:0:5842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790784293.091436:0:5842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784293.091437:0:5842:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1790784293.091441:0:5842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790784293.091452:0:5842:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000aba7aa4f) 00000020:00000080:2.0:1790784293.091464:0:5842:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1790784293.091467:0:5842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1790784293.091469:0:5842:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1790784293.091472:0:5842:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1790784293.091479:0:5842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790784293.091530:0:5842:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ea40fda1 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1790784293.091552:0:5842:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000132f5146) 00000020:00000080:2.0:1790784293.091562:0:5842:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1790784293.091631:0:5842:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1790784293.091638:0:5842:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2c3a1e2a079d33cf 00000020:00000080:2.0:1790784293.091833:0:5842:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1790784293.091840:0:5842:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1790784293.091845:0:5842:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2c3a1e2a079d33d6 00080000:01000000:2.0:1790784293.091851:0:5842:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1790784293.091855:0:5842:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2c3a1e2a079d33dd 00080000:10000000:2.0:1790784293.093079:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1790784293.093511:0:5842:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1790784293.098679:0:5842:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1790784293.254185:0:5842:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1790784293.254964:0:5842:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1790784293.268092:0:5842:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1790784293.268542:0:5842:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00010000:1.0:1790784293.375462:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790784293.394982:0:5842:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000a129a616) 00000020:00000080:1.0:1790784293.395015:0:5842:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1790784293.395125:0:5842:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1790784293.395133:0:5842:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2c3a1e2a079d33eb 00000020:00000080:0.0:1790784293.400680:0:5842:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1790784293.402174:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790784293.526361:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1790784293.595272:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1790784293.738088:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1790784293.844629:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790784293.906114:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1790784293.941848:0:5842:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2c3a1e2a079d33f2 00000020:00000080:2.0:1790784293.942324:0:5842:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1790784293.942339:0:5842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790784293.942346:0:5842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784293.942349:0:5842:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1790784293.942352:0:5842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790784293.942356:0:5842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784293.942357:0:5842:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790784293.942360:0:5842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790784293.942361:0:5842:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790784293.942364:0:5842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790784293.942365:0:5842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784293.942366:0:5842:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790784293.942369:0:5842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790784293.942407:0:5842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784293.942410:0:5842:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1790784293.942414:0:5842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1790784293.942454:0:5842:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1790784293.942519:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fd0d084a pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5842:1877773359514880:0@lo:502: 00000100:00100000:2.0:1790784293.942616:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784293.942694:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 000000007951242a going to sleep for 11 seconds 00000100:00100000:0.0:1790784293.942897:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359514880 00000100:00100000:0.0:1790784293.942907:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359514880 00000100:00100000:0.0:1790784293.942962:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790784293.942971:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a34c43f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+9:5842:x1877773359514880:12345-0@lo:502: 00000100:00100000:0.0:1790784293.943553:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a34c43f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+9:5842:x1877773359514880:12345-0@lo:502: Request processed in 581us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784293.943568:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790784293.943922:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fd0d084a pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5842:1877773359514880:0@lo:502: 00000020:01000000:3.0:1790784293.943962:0:5842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790784293.943969:0:5842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790784293.943972:0:5842:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1790784293.943978:0:5842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1790784293.944315:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1790784293.944339:0:5799:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790784293.944596:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: 00000000912a179e/0x2c3a1e2a079d33a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d33ac expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784293.944611:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: 00000000912a179e/0x2c3a1e2a079d33a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d33ac expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790784293.944620:0:5799:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff945905fd5000 from 1 10000000:01000000:0.0:1790784293.944623:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790784293.944670:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: 00000000084f445a/0x2c3a1e2a079d33f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784293.944686:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: 00000000084f445a/0x2c3a1e2a079d33f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784293.944696:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: 00000000084f445a/0x2c3a1e2a079d33f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784293.944724:0:5799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004650f48 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5799:1877773359515008:0@lo:101: 00000100:00100000:0.0:1790784293.944780:0:5799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784293.944819:0:5799:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a6be6f16 going to sleep for 11 seconds 00000100:00100000:1.0:1790784293.944938:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359515008 00000100:00100000:1.0:1790784293.944946:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359515008 00000100:00100000:1.0:1790784293.945002:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790784293.945009:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000092be910e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+9:5799:x1877773359515008:12345-0@lo:101: 00010000:00010000:1.0:1790784293.945022:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784293.945036:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000090e867f4/0x2c3a1e2a079d3400 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d33f9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784293.945060:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000090e867f4/0x2c3a1e2a079d3400 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d33f9 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784293.945071:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000090e867f4/0x2c3a1e2a079d3400 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d33f9 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784293.945079:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000090e867f4, rc 0) 00000100:00100000:1.0:1790784293.945119:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000092be910e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+10:5799:x1877773359515008:12345-0@lo:101: Request processed in 111us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784293.945126:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790784293.945245:0:5799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004650f48 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5799:1877773359515008:0@lo:101: 00010000:00010000:0.0:1790784293.945258:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: 00000000084f445a/0x2c3a1e2a079d33f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3400 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784293.945266:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: 00000000084f445a/0x2c3a1e2a079d33f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d3400 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784293.945825:0:5799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004650f48 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5799:1877773359515136:0@lo:256: 00000100:00100000:0.0:1790784293.945865:0:5799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784293.945945:0:5799:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a6be6f16 going to sleep for 11 seconds 00000100:00100000:2.0:1790784293.946105:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359515136 00000100:00100000:2.0:1790784293.946111:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359515136 00000100:00100000:2.0:1790784293.946192:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790784293.946201:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e4aab181 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+10:5799:x1877773359515136:12345-0@lo:256: 20000000:01000000:2.0:1790784293.946218:0:5812:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1790784293.946224:0:5812:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1790784293.946306:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e4aab181 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+10:5799:x1877773359515136:12345-0@lo:256: Request processed in 107us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784293.946321:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790784293.946413:0:5799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004650f48 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5799:1877773359515136:0@lo:256: 10000000:01000000:0.0:1790784293.947041:0:5799:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790784293.947061:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: 00000000084f445a/0x2c3a1e2a079d33f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3400 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784293.947071:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: 00000000084f445a/0x2c3a1e2a079d33f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3400 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790784293.947080:0:5799:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff945905fd5000 from 1 10000000:01000000:0.0:1790784293.947082:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790784293.947115:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: 000000000bd8b8bc/0x2c3a1e2a079d3407 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784293.947122:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: 000000000bd8b8bc/0x2c3a1e2a079d3407 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784293.947131:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: 000000000bd8b8bc/0x2c3a1e2a079d3407 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784293.947147:0:5799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004650f48 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5799:1877773359515264:0@lo:101: 00000100:00100000:0.0:1790784293.947189:0:5799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784293.947546:0:5799:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a6be6f16 going to sleep for 11 seconds 00000100:00100000:1.0:1790784293.947627:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359515264 00000100:00100000:1.0:1790784293.947634:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359515264 00000100:00100000:1.0:1790784293.947673:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790784293.947691:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000068838466 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+10:5799:x1877773359515264:12345-0@lo:101: 00010000:00010000:1.0:1790784293.947704:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784293.947777:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005b9f9804/0x2c3a1e2a079d340e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d3407 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784293.947804:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005b9f9804/0x2c3a1e2a079d340e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3407 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784293.947815:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005b9f9804/0x2c3a1e2a079d340e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3407 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784293.947838:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005b9f9804, rc 0) 00000100:00100000:1.0:1790784293.947885:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000068838466 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+11:5799:x1877773359515264:12345-0@lo:101: Request processed in 206us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784293.947892:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790784293.947983:0:5799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004650f48 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5799:1877773359515264:0@lo:101: 00010000:00010000:0.0:1790784293.947997:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: 000000000bd8b8bc/0x2c3a1e2a079d3407 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d340e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784293.948013:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: 000000000bd8b8bc/0x2c3a1e2a079d3407 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d340e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784293.948076:0:5799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004650f48 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5799:1877773359515392:0@lo:501: 00000100:00100000:0.0:1790784293.948103:0:5799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784293.948124:0:5799:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a6be6f16 going to sleep for 11 seconds 00000100:00100000:1.0:1790784293.948267:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359515392 00000100:00100000:1.0:1790784293.948272:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359515392 00000100:00100000:1.0:1790784293.948291:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790784293.948297:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003d00505f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+11:5799:x1877773359515392:12345-0@lo:501: 00000100:00100000:1.0:1790784293.949083:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003d00505f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+11:5799:x1877773359515392:12345-0@lo:501: Request processed in 784us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784293.949092:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790784293.949350:0:5799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004650f48 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5799:1877773359515392:0@lo:501: 00000100:00100000:0.0:1790784293.949700:0:5799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004650f48 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5799:1877773359515520:0@lo:503: 00000100:00100000:0.0:1790784293.949816:0:5799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784293.949854:0:5799:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a6be6f16 going to sleep for 11 seconds 00000100:00100000:0.0:1790784293.949872:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359515520 00000100:00100000:0.0:1790784293.949879:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359515520 00000100:00100000:0.0:1790784293.949984:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790784293.949993:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fa617b18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+11:5799:x1877773359515520:12345-0@lo:503: 00000040:00080000:0.0:1790784293.950042:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790784293.950089:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fa617b18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+11:5799:x1877773359515520:12345-0@lo:503: Request processed in 97us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784293.950096:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790784293.950242:0:5799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004650f48 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5799:1877773359515520:0@lo:503: 00000040:00080000:3.0:1790784293.951887:0:5846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1790784293.952166:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1790784293.952193:0:5799:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790784293.952247:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: 000000000bd8b8bc/0x2c3a1e2a079d3407 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d340e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784293.952261:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: 000000000bd8b8bc/0x2c3a1e2a079d3407 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d340e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790784293.952342:0:5799:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790784293.952344:0:5799:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff945905fd5000 10000000:01000000:0.0:1790784293.952348:0:5799:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff945905fd5000 10000000:01000000:0.0:1790784293.952351:0:5799:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790784293.952358:0:5799:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff945905fd5000 from 1 10000000:01000000:0.0:1790784293.952361:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790784293.952428:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: 00000000176e798a/0x2c3a1e2a079d3415 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784293.952436:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: 00000000176e798a/0x2c3a1e2a079d3415 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784293.952446:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: 00000000176e798a/0x2c3a1e2a079d3415 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784293.952469:0:5799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004650f48 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5799:1877773359515648:0@lo:101: 00000100:00100000:0.0:1790784293.952536:0:5799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784293.952627:0:5799:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e759b70a going to sleep for 11 seconds 00000100:00100000:2.0:1790784293.952891:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359515648 00000100:00100000:2.0:1790784293.952900:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359515648 00000100:00100000:2.0:1790784293.952974:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790784293.952983:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cd6741cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+11:5799:x1877773359515648:12345-0@lo:101: 00010000:00010000:2.0:1790784293.953000:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784293.953016:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000df311a7d/0x2c3a1e2a079d341c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d3415 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784293.953043:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000df311a7d/0x2c3a1e2a079d341c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3415 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784293.953054:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000df311a7d/0x2c3a1e2a079d341c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3415 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784293.953064:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000df311a7d, rc 0) 00000100:00100000:2.0:1790784293.953119:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cd6741cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:5799:x1877773359515648:12345-0@lo:101: Request processed in 137us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784293.953126:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790784293.953206:0:5799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004650f48 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5799:1877773359515648:0@lo:101: 00010000:00010000:0.0:1790784293.953221:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: 00000000176e798a/0x2c3a1e2a079d3415 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d341c expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784293.953230:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: 00000000176e798a/0x2c3a1e2a079d3415 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d341c expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784293.953284:0:5799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004650f48 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5799:1877773359515776:0@lo:501: 00000100:00100000:0.0:1790784293.953309:0:5799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784293.953537:0:5799:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e759b70a going to sleep for 11 seconds 00000100:00100000:1.0:1790784293.953607:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359515776 00000100:00100000:1.0:1790784293.953612:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359515776 00000100:00100000:1.0:1790784293.953635:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790784293.953641:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c90e77ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:5799:x1877773359515776:12345-0@lo:501: 00000100:00100000:1.0:1790784293.954018:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c90e77ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:5799:x1877773359515776:12345-0@lo:501: Request processed in 375us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784293.954025:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790784293.954143:0:5799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004650f48 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5799:1877773359515776:0@lo:501: 00000100:00100000:3.0:1790784293.954195:0:5799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000036e08712 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5799:1877773359515904:0@lo:503: 00000100:00100000:3.0:1790784293.954234:0:5799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784293.954261:0:5799:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c319277 going to sleep for 11 seconds 00000100:00100000:1.0:1790784293.954301:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359515904 00000100:00100000:1.0:1790784293.954305:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359515904 00000100:00100000:1.0:1790784293.954323:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790784293.954327:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000096ad552 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:5799:x1877773359515904:12345-0@lo:503: 00000100:00100000:1.0:1790784293.954671:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000096ad552 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:5799:x1877773359515904:12345-0@lo:503: Request processed in 343us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784293.954815:0:5799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000036e08712 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5799:1877773359515904:0@lo:503: 00000100:00100000:1.0:1790784293.955015:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790784293.955653:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000022ba8a1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5847:1877773359516032:0@lo:502: 00000100:00100000:1.0:1790784293.955842:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784293.955889:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set 000000001fa3d073 going to sleep for 11 seconds 00000100:00100000:2.0:1790784293.955948:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359516032 00000100:00100000:2.0:1790784293.955955:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359516032 00000100:00100000:2.0:1790784293.955998:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790784293.956006:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000baff0ee5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:5847:x1877773359516032:12345-0@lo:502: 00000100:00100000:2.0:1790784293.956445:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000baff0ee5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:5847:x1877773359516032:12345-0@lo:502: Request processed in 369us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784293.956454:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790784293.956631:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000022ba8a1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5847:1877773359516032:0@lo:502: 00000020:01000004:1.0:1790784293.956709:0:5847:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1790784293.957001:0:5847:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000001258de16) 00000020:00000080:1.0:1790784293.957026:0:5847:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1790784293.957148:0:5847:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ea40fda1 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790784293.957153:0:5847:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000ea40fda1 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790784293.957156:0:5847:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000ea40fda1 4 00010000:00080000:1.0:1790784293.957200:0:5847:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000cb54f561@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.132@tcp at head 00010000:00010000:1.0:1790784293.959587:0:5847:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1790784293.961595:0:5847:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1790784293.961657:0:5847:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790784293.961675:0:5847:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2c3a1e2a079d342a 00000100:00080000:1.0:1790784293.961698:0:5847:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790784293.961712:0:5847:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000cb54f561 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:1.0:1790784293.961836:0:5847:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000022ba8a1 x1877773359516160/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790784293.963144:0:5847:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790784293.963283:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000022ba8a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3278:1877773359516160:0@lo:38: 00000100:00100000:0.0:1790784293.963414:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784293.963865:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359516160 00000100:00100000:1.0:1790784293.963877:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359516160 00000100:00100000:1.0:1790784293.963923:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790784293.963929:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009f2bc046 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3278:x1877773359516160:12345-0@lo:38: 00000100:00100000:1.0:1790784293.964022:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009f2bc046 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3278:x1877773359516160:12345-0@lo:38: Request processed in 92us (609us total) trans 0 rc -11/-11 00000100:00100000:1.0:1790784293.964030:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790784293.964173:0:3278:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790784293.964183:0:3278:0:(import.c:65:import_set_state_nolock()) 00000000cb54f561 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790784293.964188:0:3278:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1790784293.964191:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000022ba8a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3278:1877773359516160:0@lo:38: 00000100:00100000:2.0:1790784293.966894:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000997e9a09 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5847:1877773359516288:0@lo:502: 00000100:00100000:2.0:1790784293.967006:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784293.967058:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359516288 00000100:00100000:2.0:1790784293.967066:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359516288 00000100:00100000:2.0:1790784293.967118:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790784293.967126:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000e492922 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:5847:x1877773359516288:12345-0@lo:502: 00000100:00100000:2.0:1790784293.967574:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000e492922 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:5847:x1877773359516288:12345-0@lo:502: Request processed in 447us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784293.967583:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790784293.967870:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set 000000005bdd1678 going to sleep for 11 seconds 00000100:00100000:2.0:1790784293.967898:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000997e9a09 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5847:1877773359516288:0@lo:502: 00000040:00080000:2.0:1790784293.967930:0:5847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1790784293.970536:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1790784293.970597:0:5799:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790784293.970668:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: 00000000176e798a/0x2c3a1e2a079d3415 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d341c expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784293.970692:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: 00000000176e798a/0x2c3a1e2a079d3415 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d341c expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790784293.972064:0:5799:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790784293.972069:0:5799:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790784293.972075:0:5799:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790784293.972077:0:5799:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790784293.972078:0:5799:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790784293.972080:0:5799:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790784293.972082:0:5799:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790784293.972083:0:5799:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790784293.972085:0:5799:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790784293.972086:0:5799:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790784293.972087:0:5799:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790784293.972089:0:5799:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790784293.972093:0:5799:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1790784293.972096:0:5799:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790784293.972098:0:5799:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790784293.972099:0:5799:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790784293.972100:0:5799:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790784293.972101:0:5799:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790784293.972102:0:5799:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790784293.972103:0:5799:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790784293.972103:0:5799:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790784293.972104:0:5799:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790784293.972105:0:5799:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790784293.972106:0:5799:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790784293.972107:0:5799:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790784293.972153:0:5799:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1790784293.972176:0:5799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000645a5f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5799:1877773359516416:0@lo:253: 00000100:00100000:1.0:1790784293.972265:0:5799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784293.972322:0:5799:0:(client.c:2716:ptlrpc_set_wait()) set 00000000902d9c44 going to sleep for 11 seconds 00000100:00100000:3.0:1790784293.973807:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359516416 00000100:00100000:3.0:1790784293.973827:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359516416 00000100:00100000:3.0:1790784293.973907:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790784293.973918:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f2291c79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:5799:x1877773359516416:12345-0@lo:253: 20000000:01000000:3.0:1790784293.973964:0:5811:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1790784293.973981:0:5811:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1790784294.010729:0:5811:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790784294.010753:0:5811:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1790784294.010876:0:5834:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790784294.010883:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790784294.010910:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a9850aec/0x2c3a1e2a079d3431 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784294.010935:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000090e867f4/0x2c3a1e2a079d3400 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d33f9 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784294.010944:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a9850aec/0x2c3a1e2a079d3431 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784294.010999:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000090e867f4/0x2c3a1e2a079d3400 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d33f9 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784294.011018:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000090e867f4/0x2c3a1e2a079d3400 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d33f9 expref: 12 pid: 5810 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784294.011035:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e300bb9d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5834:1877773359516544:0@lo:104: 00000100:00100000:0.0:1790784294.011124:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784294.011201:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set 000000002693b7bc going to sleep for 11 seconds 00000100:00100000:1.0:1790784294.011351:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359516544 00000100:00100000:1.0:1790784294.011363:0:5800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359516544 00000100:00100000:1.0:1790784294.011450:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790784294.011459:0:5800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001669dacc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+3:5834:x1877773359516544:12345-0@lo:104: 00010000:00010000:1.0:1790784294.011473:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: 00000000084f445a/0x2c3a1e2a079d33f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d3400 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784294.011535:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790784294.011542:0:5800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001669dacc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+3:5834:x1877773359516544:12345-0@lo:104: Request processed in 84us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784294.011564:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1790784294.011587:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790784294.011593:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: 00000000084f445a/0x2c3a1e2a079d33f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d3400 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784294.011601:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000084f445a already unused, calling callback (000000005881e2a3) 10000000:00010000:1.0:1790784294.011604:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: 00000000084f445a/0x2c3a1e2a079d33f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d3400 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784294.011613:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: 00000000084f445a/0x2c3a1e2a079d33f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d3400 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790784294.011620:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: 00000000084f445a/0x2c3a1e2a079d33f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d3400 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790784294.011626:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790784294.011654:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: 00000000084f445a/0x2c3a1e2a079d33f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3400 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784294.011660:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790784294.011676:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: 00000000084f445a/0x2c3a1e2a079d33f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3400 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784294.011696:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: 00000000084f445a/0x2c3a1e2a079d33f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3400 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784294.011713:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784294.011715:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784294.011717:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784294.012281:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ecd0dc41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3280:1877773359516672:0@lo:103: 00000100:00100000:0.0:1790784294.012330:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784294.012479:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e300bb9d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5834:1877773359516544:0@lo:104: 00010000:00010000:0.0:1790784294.012501:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a9850aec/0x2c3a1e2a079d3431 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784294.013484:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359516672 00000100:00100000:2.0:1790784294.013496:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359516672 00010000:00010000:2.0:1790784294.013533:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000090e867f4/0x2c3a1e2a079d3400 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d33f9 expref: 13 pid: 5810 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784294.013572:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790784294.013580:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000071f5b48a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:3280:x1877773359516672:12345-0@lo:103: 00010000:00010000:2.0:1790784294.013593:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784294.013597:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000090e867f4/0x2c3a1e2a079d3400 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d33f9 expref: 13 pid: 5810 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784294.013608:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000090e867f4/0x2c3a1e2a079d3400 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d33f9 expref: 13 pid: 5810 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784294.013624:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000090e867f4/0x2c3a1e2a079d3400 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d33f9 expref: 13 pid: 5810 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784294.013660:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a9850aec/0x2c3a1e2a079d3431 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784294.013669:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a9850aec/0x2c3a1e2a079d3431 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790784294.013699:0:5802:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002816997s 00010000:00010000:2.0:1790784294.013703:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a9850aec/0x2c3a1e2a079d3431 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784294.013710:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a9850aec/0x2c3a1e2a079d3431 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784294.013727:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a9850aec/0x2c3a1e2a079d3431 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784294.013734:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a9850aec/0x2c3a1e2a079d3431 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784294.013739:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a9850aec already unused, calling callback (000000005eb8f29d) 00010000:00010000:2.0:1790784294.013743:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a9850aec/0x2c3a1e2a079d3431 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784294.013751:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a9850aec/0x2c3a1e2a079d3431 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784294.013769:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a9850aec/0x2c3a1e2a079d3431 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784294.013781:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790784294.013854:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000071f5b48a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:3280:x1877773359516672:12345-0@lo:103: Request processed in 274us (1523us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784294.013862:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790784294.013911:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ecd0dc41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3280:1877773359516672:0@lo:103: 00010000:00010000:2.0:1790784294.013939:0:5834:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a9850aec/0x2c3a1e2a079d3431 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784294.013946:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a9850aec/0x2c3a1e2a079d3431 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784294.013952:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a9850aec/0x2c3a1e2a079d3431 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784294.021334:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f2291c79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+11:5799:x1877773359516416:12345-0@lo:253: Request processed in 47406us (49057us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784294.021355:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790784294.022864:0:5799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000645a5f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5799:1877773359516416:0@lo:253: 10000000:01000000:1.0:1790784294.023047:0:5799:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790784294.023052:0:5799:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790784294.023054:0:5799:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790784294.023055:0:5799:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790784294.023057:0:5799:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790784294.023058:0:5799:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790784294.023059:0:5799:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790784294.023061:0:5799:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790784294.023062:0:5799:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790784294.023063:0:5799:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790784294.023065:0:5799:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790784294.023066:0:5799:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790784294.023068:0:5799:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790784294.023087:0:5799:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1790784294.029356:0:5799:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1790784294.030109:0:5799:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1790784294.030343:0:5799:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1790784294.030870:0:5799:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1790784294.031152:0:5799:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1790784294.031343:0:5799:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1790784294.032810:0:5799:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1790784294.032996:0:5799:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1790784294.033220:0:5799:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1790784294.033420:0:5799:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1790784294.033603:0:5799:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1790784294.033879:0:5799:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1790784294.089278:0:5799:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1790784294.170402:0:5799:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1790784294.172438:0:5853:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:1.0:1790784294.176160:0:5852:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1790784294.176172:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1790784294.179070:0:5799:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1790784294.179282:0:5799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1790784294.179746:0:5799:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1790784294.179755:0:5799:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1790784294.179910:0:5799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790784294.183605:0:5799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1790784294.185143:0:5799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1790784294.185216:0:5799:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1790784294.186416:0:5799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1790784294.186694:0:5799:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1790784294.192312:0:5799:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1790784294.192470:0:5799:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1790784294.192651:0:5799:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1790784294.192829:0:5799:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1790784294.192984:0:5799:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1790784294.193132:0:5799:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1790784294.195176:0:5799:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1790784294.195353:0:5799:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1790784294.195518:0:5799:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1790784294.195638:0:5799:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1790784294.196620:0:5799:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1790784294.196827:0:5799:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1790784294.196995:0:5799:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1790784294.197129:0:5799:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1790784294.197260:0:5799:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1790784294.197454:0:5799:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1790784294.197771:0:5799:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1790784294.197935:0:5799:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1790784294.198091:0:5799:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1790784294.198218:0:5799:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1790784294.198425:0:5799:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1790784294.198566:0:5799:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1790784294.198755:0:5799:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1790784294.198908:0:5799:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1790784294.199062:0:5799:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1790784294.199199:0:5799:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1790784294.202283:0:5799:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1790784294.202557:0:5799:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1790784294.203098:0:5799:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1790784294.203243:0:5799:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1790784294.203414:0:5799:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1790784294.203547:0:5799:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1790784294.206878:0:5799:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1790784294.311648:0:5853:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00010000:0.0:1790784294.395362:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790784294.413071:0:5799:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1790784294.413113:0:5799:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffae2cc1c5b988 00100000:10000000:0.0:1790784294.413123:0:5799:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1790784294.414795:0:5799:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790784294.414815:0:5799:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.132@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790784294.414834:0:5799:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1790784294.414855:0:5799:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1790784294.416067:0:5853:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1790784294.416337:0:5853:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1790784294.416344:0:5853:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1790784295.421817:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784296.445511:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784297.466607:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784298.490552:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790784299.451472:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790784299.451479:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff945905fd5000 from 3 10000000:01000000:2.0:1790784299.451484:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790784299.451603:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: 00000000530f082d/0x2c3a1e2a079d3438 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784299.451616:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: 00000000530f082d/0x2c3a1e2a079d3438 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784299.451625:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: 00000000530f082d/0x2c3a1e2a079d3438 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784299.451646:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000997e9a09 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359516800:0@lo:101: 00000100:00100000:2.0:1790784299.451719:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784299.451773:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a0093236 going to sleep for 11 seconds 00000100:00100000:3.0:1790784299.457854:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359516800 00000100:00100000:3.0:1790784299.457869:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359516800 00000100:00100000:3.0:1790784299.457913:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790784299.457921:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000786c0925 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+11:5815:x1877773359516800:12345-0@lo:101: 00010000:00010000:3.0:1790784299.457937:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784299.457955:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b6ae05d6/0x2c3a1e2a079d343f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d3438 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784299.457982:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b6ae05d6/0x2c3a1e2a079d343f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3438 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784299.457993:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b6ae05d6/0x2c3a1e2a079d343f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3438 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784299.458001:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b6ae05d6, rc 0) 00000100:00080000:2.0:1790784299.458021:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790784299.458026:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790784299.458033:0:8:0:(import.c:65:import_set_state_nolock()) 00000000cb54f561 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790784299.458042:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000cb54f561 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:2.0:1790784299.458070:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007a01dde9 x1877773359516928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790784299.458075:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000786c0925 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:5815:x1877773359516800:12345-0@lo:101: Request processed in 156us (6357us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784299.458082:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790784299.458105:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007a01dde9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3278:1877773359516928:0@lo:38: 00000100:00100000:2.0:1790784299.458142:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784299.458219:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000997e9a09 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359516800:0@lo:101: 00010000:00010000:2.0:1790784299.458233:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: 00000000530f082d/0x2c3a1e2a079d3438 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d343f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784299.458242:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: 00000000530f082d/0x2c3a1e2a079d3438 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d343f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784299.458299:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000997e9a09 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359517056:0@lo:256: 00000100:00100000:2.0:1790784299.458330:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784299.458358:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a0093236 going to sleep for 11 seconds 00000100:00100000:2.0:1790784299.458371:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359517056 00000100:00100000:2.0:1790784299.458392:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359517056 00000100:00100000:2.0:1790784299.458416:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790784299.458422:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002474a162 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:5815:x1877773359517056:12345-0@lo:256: 20000000:01000000:2.0:1790784299.458435:0:5811:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790784299.458450:0:5811:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790784299.458453:0:5811:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1790784299.458542:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002474a162 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:5815:x1877773359517056:12345-0@lo:256: Request processed in 120us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784299.458550:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790784299.458583:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000997e9a09 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359517056:0@lo:256: 10000000:01000000:2.0:1790784299.458622:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790784299.458628:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: 00000000530f082d/0x2c3a1e2a079d3438 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d343f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784299.458636:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: 00000000530f082d/0x2c3a1e2a079d3438 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d343f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784299.458794:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359516928 00000100:00100000:3.0:1790784299.458799:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359516928 00000100:00100000:3.0:1790784299.458831:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790784299.458835:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eeec7f37 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3278:x1877773359516928:12345-0@lo:38: 00010000:00080000:3.0:1790784299.458852:0:5820:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 133 last 0 00000020:00000080:3.0:1790784299.458882:0:5820:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2c3a1e2a079d3446 00000004:00100000:3.0:1790784299.458925:0:5820:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790784299.459030:0:5820:0:(import.c:65:import_set_state_nolock()) 0000000023c8f871 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790784299.459069:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eeec7f37 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1877773359516928:12345-0@lo:38: Request processed in 232us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784299.459075:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790784299.459445:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007a01dde9 x1877773359516928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790784309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790784299.459458:0:3278:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1790784299.459465:0:3278:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1790784299.459470:0:3278:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790784299.459472:0:3278:0:(import.c:65:import_set_state_nolock()) 00000000cb54f561 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790784299.459477:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007a01dde9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3278:1877773359516928:0@lo:38: 00010000:00010000:0.0:1790784299.515053:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790784299.761261:0:6096:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg632-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790784300.539173:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784301.562551:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784302.586879:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784303.610576:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790784304.572146:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000997e9a09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1877773359517312:0@lo:400: 00000100:00100000:1.0:1790784304.572247:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784304.572439:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359517312 00000100:00100000:2.0:1790784304.572448:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359517312 00000100:00100000:2.0:1790784304.572496:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790784304.572504:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000645a5f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1877773359517312:12345-0@lo:400: 00000100:00100000:2.0:1790784304.572585:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000645a5f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1877773359517312:12345-0@lo:400: Request processed in 81us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784304.572602:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790784304.572777:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000997e9a09 x1877773359517312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790784320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790784304.572791:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000997e9a09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1877773359517312:0@lo:400: 00000100:00100000:1.0:1790784304.572818:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790784304.572826:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007a01dde9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359517184:0@lo:400: 00000100:00100000:1.0:1790784304.572943:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784304.573046:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359517184 00000100:00100000:1.0:1790784304.573051:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359517184 00000100:00100000:1.0:1790784304.573108:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790784304.573120:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003b0f3113 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:3282:x1877773359517184:12345-0@lo:400: 00000100:00100000:1.0:1790784304.573178:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003b0f3113 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:3282:x1877773359517184:12345-0@lo:400: Request processed in 62us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784304.573188:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790784304.573252:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007a01dde9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359517184:0@lo:400: 00010000:00010000:0.0:1790784304.634688:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790784305.029513:0:6298:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd03c99950 20000000:00000080:2.0:1790784305.029543:0:6298:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff945905f62800 uarg=0000000000000000 20000000:01000000:2.0:1790784305.029585:0:6298:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1790784305.029594:0:6298:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1790784305.029600:0:6298:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1790784305.036641:0:6298:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1790784305.036663:0:6298:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1790784305.044449:0:6298:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790784305.048028:0:6298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1790784305.048148:0:6298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1790784305.049143:0:6298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1790784305.051313:0:6298:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790784305.051352:0:6298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005423e777/0x2c3a1e2a079d344d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784305.053063:0:6298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005b9f9804/0x2c3a1e2a079d340e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3407 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784305.053085:0:6298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005423e777/0x2c3a1e2a079d344d lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784305.053294:0:6298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005b9f9804/0x2c3a1e2a079d340e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d3407 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784305.053315:0:6298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005b9f9804/0x2c3a1e2a079d340e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3407 expref: 11 pid: 5810 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784305.053333:0:6298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000036e08712 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6298:1877773359517440:0@lo:104: 00000100:00100000:3.0:1790784305.053454:0:6298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784305.053549:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359517440 00000100:00100000:2.0:1790784305.053564:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359517440 00000100:00100000:2.0:1790784305.053634:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790784305.053645:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b1e5edbd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+3:6298:x1877773359517440:12345-0@lo:104: 00010000:00010000:2.0:1790784305.054116:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: 000000000bd8b8bc/0x2c3a1e2a079d3407 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d340e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784305.054757:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790784305.054766:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b1e5edbd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+3:6298:x1877773359517440:12345-0@lo:104: Request processed in 1122us (1313us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784305.054774:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790784305.054864:0:6298:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e3a6b16e going to sleep for 11 seconds 00000100:00100000:3.0:1790784305.054902:0:6298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000036e08712 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6298:1877773359517440:0@lo:104: 00010000:00010000:3.0:1790784305.055010:0:6298:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005423e777/0x2c3a1e2a079d344d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784305.056262:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790784305.056273:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: 000000000bd8b8bc/0x2c3a1e2a079d3407 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d340e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784305.056285:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000bd8b8bc already unused, calling callback (000000005881e2a3) 10000000:00010000:0.0:1790784305.056288:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: 000000000bd8b8bc/0x2c3a1e2a079d3407 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d340e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784305.056297:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: 000000000bd8b8bc/0x2c3a1e2a079d3407 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d340e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790784305.056478:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: 000000000bd8b8bc/0x2c3a1e2a079d3407 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d340e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790784305.056506:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790784305.056612:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: 000000000bd8b8bc/0x2c3a1e2a079d3407 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d340e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784305.056620:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790784305.056672:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: 000000000bd8b8bc/0x2c3a1e2a079d3407 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d340e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784305.056679:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: 000000000bd8b8bc/0x2c3a1e2a079d3407 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d340e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784305.056701:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784305.056703:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784305.056704:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790784305.056833:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e300bb9d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359517568:0@lo:103: 00000100:00100000:1.0:1790784305.056918:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784305.057238:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359517568 00000100:00100000:0.0:1790784305.057246:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359517568 00010000:00010000:0.0:1790784305.057274:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005b9f9804/0x2c3a1e2a079d340e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3407 expref: 12 pid: 5810 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784305.057315:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790784305.057323:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000347ea89d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:3279:x1877773359517568:12345-0@lo:103: 00010000:00010000:0.0:1790784305.057336:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784305.057341:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005b9f9804/0x2c3a1e2a079d340e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3407 expref: 12 pid: 5810 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784305.057351:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005b9f9804/0x2c3a1e2a079d340e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3407 expref: 12 pid: 5810 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784305.057364:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005b9f9804/0x2c3a1e2a079d340e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d3407 expref: 12 pid: 5810 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784305.057810:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005423e777/0x2c3a1e2a079d344d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784305.057822:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005423e777/0x2c3a1e2a079d344d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784305.057837:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005423e777/0x2c3a1e2a079d344d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784305.057844:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005423e777/0x2c3a1e2a079d344d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784305.057849:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005423e777/0x2c3a1e2a079d344d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784305.057855:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005423e777/0x2c3a1e2a079d344d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784305.057860:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005423e777 already unused, calling callback (000000005eb8f29d) 00010000:00010000:0.0:1790784305.058006:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005423e777/0x2c3a1e2a079d344d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784305.058015:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005423e777/0x2c3a1e2a079d344d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784305.058033:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005423e777/0x2c3a1e2a079d344d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784305.058044:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790784305.058551:0:6298:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005423e777/0x2c3a1e2a079d344d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784305.058571:0:6298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005423e777/0x2c3a1e2a079d344d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784305.058579:0:6298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005423e777/0x2c3a1e2a079d344d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784305.063454:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000347ea89d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+11:3279:x1877773359517568:12345-0@lo:103: Request processed in 6123us (6526us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784305.063488:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790784305.063654:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e300bb9d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359517568:0@lo:103: 00010000:00010000:1.0:1790784305.660791:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790784306.426783:0:5815:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790784306.426790:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff945905fd5000 from 1 10000000:01000000:2.0:1790784306.426795:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790784306.426838:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: 0000000040351d49/0x2c3a1e2a079d3454 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784306.427546:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: 0000000040351d49/0x2c3a1e2a079d3454 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784306.427559:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: 0000000040351d49/0x2c3a1e2a079d3454 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784306.427582:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000470d5a96 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359517696:0@lo:101: 00000100:00100000:2.0:1790784306.427723:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784306.427773:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c782122 going to sleep for 11 seconds 00000100:00100000:0.0:1790784306.428019:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359517696 00000100:00100000:0.0:1790784306.428027:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359517696 00000100:00100000:0.0:1790784306.428077:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790784306.428085:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005850236e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+11:5815:x1877773359517696:12345-0@lo:101: 00010000:00010000:0.0:1790784306.428100:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784306.428113:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a9850aec/0x2c3a1e2a079d345b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d3454 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784306.428135:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a9850aec/0x2c3a1e2a079d345b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3454 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784306.428156:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a9850aec/0x2c3a1e2a079d345b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3454 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784306.428165:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a9850aec, rc 0) 00000100:00100000:0.0:1790784306.428201:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005850236e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:5815:x1877773359517696:12345-0@lo:101: Request processed in 117us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784306.428208:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790784306.429509:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000470d5a96 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359517696:0@lo:101: 00010000:00010000:2.0:1790784306.429549:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: 0000000040351d49/0x2c3a1e2a079d3454 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d345b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784306.429558:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: 0000000040351d49/0x2c3a1e2a079d3454 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d345b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784306.429629:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000470d5a96 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359517824:0@lo:501: 00000100:00100000:2.0:1790784306.429729:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784306.429773:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c782122 going to sleep for 11 seconds 00000100:00100000:0.0:1790784306.429834:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359517824 00000100:00100000:0.0:1790784306.429839:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359517824 00000100:00100000:0.0:1790784306.430107:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790784306.430114:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000016d5c35a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:5815:x1877773359517824:12345-0@lo:501: 00000100:00100000:0.0:1790784306.430402:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000016d5c35a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:5815:x1877773359517824:12345-0@lo:501: Request processed in 288us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784306.430410:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790784306.431821:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000470d5a96 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359517824:0@lo:501: 00000100:00100000:2.0:1790784306.431888:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000470d5a96 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359517952:0@lo:503: 00000100:00100000:2.0:1790784306.431954:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784306.431995:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c782122 going to sleep for 11 seconds 00000100:00100000:0.0:1790784306.433306:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359517952 00000100:00100000:0.0:1790784306.433317:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359517952 00000100:00100000:0.0:1790784306.433395:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790784306.433405:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000531b1f3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:5815:x1877773359517952:12345-0@lo:503: 00000100:00100000:0.0:1790784306.433587:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000531b1f3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:5815:x1877773359517952:12345-0@lo:503: Request processed in 184us (1633us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784306.433595:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790784306.434810:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000470d5a96 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359517952:0@lo:503: 00000100:00100000:2.0:1790784306.437329:0:6348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000470d5a96 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6348:1877773359518080:0@lo:502: 00000100:00100000:2.0:1790784306.437430:0:6348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784306.437465:0:6348:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fea850cf going to sleep for 11 seconds 00000100:00100000:0.0:1790784306.437803:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359518080 00000100:00100000:0.0:1790784306.437811:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359518080 00000100:00100000:0.0:1790784306.437871:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790784306.437878:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005ba67ec9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:6348:x1877773359518080:12345-0@lo:502: 00000100:00100000:0.0:1790784306.438207:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005ba67ec9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:6348:x1877773359518080:12345-0@lo:502: Request processed in 329us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784306.438215:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790784306.438336:0:6348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000470d5a96 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6348:1877773359518080:0@lo:502: 00000020:01000000:2.0:1790784306.438366:0:6348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790784306.438402:0:6348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784306.438405:0:6348:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790784306.438412:0:6348:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff945905fd5000 00000020:00000080:2.0:1790784306.438414:0:6348:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790784306.438456:0:6348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6348:1877773359518208:0@lo:502: 00000100:00100000:2.0:1790784306.438503:0:6348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784306.438529:0:6348:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910ff9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790784306.440825:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359518208 00000100:00100000:0.0:1790784306.440839:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359518208 00000100:00100000:0.0:1790784306.440905:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790784306.440925:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:6348:x1877773359518208:12345-0@lo:502: 00000100:00100000:0.0:1790784306.441123:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:6348:x1877773359518208:12345-0@lo:502: Request processed in 208us (2618us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784306.441132:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790784306.442177:0:6348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6348:1877773359518208:0@lo:502: 00000020:01000000:2.0:1790784306.442210:0:6348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790784306.442217:0:6348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784306.442220:0:6348:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1790784306.442224:0:6348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1790784306.443010:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1790784306.443031:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790784306.443040:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945909574600/0x2c3a1e2a079d3454 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d345b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784306.443052:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff945909574600/0x2c3a1e2a079d3454 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d345b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784306.682836:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784307.706770:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784308.730534:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784309.696580:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3280:1877773359518336:0@lo:400: 00000100:00100000:2.0:1790784309.696674:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784309.696844:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1877773359518464:0@lo:400: 00000100:00100000:2.0:1790784309.696942:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784309.696988:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359518336 00000100:00100000:2.0:1790784309.696997:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359518336 00000100:00100000:2.0:1790784309.697041:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790784309.697052:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:3280:x1877773359518336:12345-0@lo:400: 00000100:00100000:2.0:1790784309.697106:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:3280:x1877773359518336:12345-0@lo:400: Request processed in 54us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784309.697116:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790784309.697152:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359518464 00000100:00100000:2.0:1790784309.697156:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359518464 00000100:00100000:2.0:1790784309.697253:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790784309.697261:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1877773359518464:12345-0@lo:400: 00000100:00100000:2.0:1790784309.697295:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1877773359518464:12345-0@lo:400: Request processed in 36us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784309.697301:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790784309.697332:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3280:1877773359518336:0@lo:400: 00010000:00080000:2.0:1790784309.697363:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94593c29c000 x1877773359518464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790784325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790784309.697859:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1877773359518464:0@lo:400: 00010000:00010000:0.0:1790784309.758123:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784310.778555:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790784311.433991:0:6665:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790784311.433995:0:6665:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1790784311.434133:0:6665:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9459050db000 00000020:01000004:1.0:1790784311.434148:0:6665:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1790784311.434158:0:6665:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1790784311.434171:0:6665:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff945935d719c0) 00000020:00000080:1.0:1790784311.434185:0:6665:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1790784311.451246:0:6665:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1790784311.451741:0:6665:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1790784311.497161:0:6665:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1790784311.507930:0:6665:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1790784311.507964:0:6665:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1790784311.508023:0:6665:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1790784311.508052:0:6665:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1790784311.508568:0:6665:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1790784311.508578:0:6665:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790784311.508599:0:6665:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2c3a1e2a079d3469 00000020:01000004:3.0:1790784311.508607:0:6665:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1790784311.508628:0:6665:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.132@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790784311.508631:0:6665:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790784311.508637:0:6665:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1790784311.508641:0:6665:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1790784311.508661:0:6665:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff94592d4c99c0) 00000020:00000080:3.0:1790784311.508672:0:6665:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1790784311.512609:0:6665:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790784311.512922:0:6665:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1790784311.512929:0:6665:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1790784311.515734:0:6665:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1790784311.515745:0:6665:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1790784311.517543:0:6665:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1790784311.517552:0:6665:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1790784311.520180:0:6665:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790784311.520365:0:6665:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1790784311.520372:0:6665:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1790784311.521631:0:6665:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1790784311.521640:0:6665:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1790784311.551032:0:6665:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790784311.551329:0:6665:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1790784311.551336:0:6665:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1790784311.554706:0:6665:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1790784311.554719:0:6665:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1790784311.555881:0:6665:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790784311.555891:0:6665:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1790784311.559306:0:6665:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790784311.559525:0:6665:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1790784311.559532:0:6665:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1790784311.565406:0:6665:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1790784311.565417:0:6665:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1790784311.631194:0:6665:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790784311.631460:0:6665:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1790784311.631466:0:6665:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1790784311.632821:0:6665:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1790784311.632831:0:6665:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1790784311.633331:0:6665:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1790784311.633353:0:6665:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1790784311.633359:0:6665:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.132@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1790784311.660797:0:6665:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.132@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790784311.660833:0:6665:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.132@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1790784311.660837:0:6665:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790784311.660839:0:6665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790784311.660840:0:6665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790784311.660842:0:6665:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790784311.660843:0:6665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790784311.660848:0:6665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790784311.660849:0:6665:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790784311.660851:0:6665:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790784311.660852:0:6665:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790784311.660854:0:6665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790784311.660855:0:6665:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790784311.660859:0:6665:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1790784311.660861:0:6665:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790784311.660862:0:6665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790784311.660864:0:6665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790784311.660865:0:6665:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790784311.660866:0:6665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790784311.660867:0:6665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790784311.660868:0:6665:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790784311.660869:0:6665:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790784311.660870:0:6665:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790784311.660871:0:6665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790784311.660872:0:6665:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790784311.660973:0:6665:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1790784311.660991:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d220e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359518592:0@lo:253: 00000100:00100000:3.0:1790784311.661059:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784311.661178:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff945902d5a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790784311.661305:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359518592 00000100:00100000:0.0:1790784311.661312:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359518592 00000100:00100000:0.0:1790784311.661368:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790784311.661633:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:6665:x1877773359518592:12345-0@lo:253: 20000000:01000000:0.0:1790784311.662540:0:5810:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1790784311.662545:0:5810:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1790784311.662550:0:5810:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1790784311.662553:0:5810:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1790784311.666793:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790784311.667009:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1790784311.667022:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1790784311.667063:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1790784311.667070:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1790784311.667099:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1790784311.667144:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1790784311.675764:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1790784311.675800:0:5810:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.132@tcp 20000000:01000000:2.0:1790784311.675803:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.132@tcp (null) (null) (null) 00000040:00080000:2.0:1790784311.675880:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1790784311.678490:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1790784311.678667:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1790784311.678682:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.132@tcp (null) (null) 00000040:00080000:2.0:1790784311.678720:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1790784311.678730:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1790784311.678764:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1790784311.678819:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1790784311.682735:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1790784311.682763:0:5810:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.132@tcp 20000000:01000000:2.0:1790784311.682765:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.132@tcp (null) (null) (null) 00000040:00080000:2.0:1790784311.682799:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1790784311.682806:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1790784311.682856:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1790784311.682864:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.132@tcp (null) (null) 00000040:00080000:2.0:1790784311.684612:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1790784311.684635:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1790784311.684685:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1790784311.684722:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1790784311.684743:0:5810:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1790784311.684746:0:5810:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1790784311.684750:0:5810:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1790784311.684761:0:5810:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790784311.684763:0:5810:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1790784311.684798:0:5810:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1790784311.684801:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790784311.687650:0:6680:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1790784311.691572:0:6680:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1790784311.691666:0:6680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1790784311.692710:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1790784311.692755:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1790784311.692789:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1790784311.692804:0:5810:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1790784311.692806:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790784311.694696:0:6681:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1790784311.694775:0:6681:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1790784311.694835:0:6681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1790784311.695200:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1790784311.695255:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1790784311.695313:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1790784311.695326:0:5810:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1790784311.695328:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1790784311.696620:0:6682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1790784311.696877:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1790784311.697029:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1790784311.697109:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1790784311.697127:0:5810:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1790784311.697129:0:5810:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1790784311.697138:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1790784311.697162:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff945901524800/0x2c3a1e2a079d3477 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784311.697179:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff945901524400/0x2c3a1e2a079d3390 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3389 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784311.697187:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff945909575200/0x2c3a1e2a079d33ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d33a5 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784311.697195:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff945909575400/0x2c3a1e2a079d341c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3415 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784311.697202:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff945901524800/0x2c3a1e2a079d3477 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784311.697987:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff945909575400/0x2c3a1e2a079d341c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d3415 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784311.698007:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff945909575400/0x2c3a1e2a079d341c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3415 expref: 12 pid: 5812 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784311.698020:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d220380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5810:1877773359518720:0@lo:104: 00000100:00100000:3.0:1790784311.698080:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784311.698209:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359518720 00000100:00100000:2.0:1790784311.698217:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359518720 00000100:00100000:2.0:1790784311.698274:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790784311.698283:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d223b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+3:5810:x1877773359518720:12345-0@lo:104: 00010000:00010000:2.0:1790784311.698295:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff945900031c00/0x2c3a1e2a079d3415 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d341c expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.698339:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790784311.698345:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d223b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+3:5810:x1877773359518720:12345-0@lo:104: Request processed in 64us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784311.698351:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1790784311.699979:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff945909575200/0x2c3a1e2a079d33ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d33a5 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784311.699995:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff945909575200/0x2c3a1e2a079d33ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d33a5 expref: 12 pid: 5811 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784311.700008:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d220000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5810:1877773359518848:0@lo:104: 00000100:00100000:3.0:1790784311.700057:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784311.700257:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359518848 00000100:00100000:1.0:1790784311.700264:0:5800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359518848 00000100:00100000:1.0:1790784311.700297:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790784311.700306:0:5800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d221f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+3:5810:x1877773359518848:12345-0@lo:104: 00010000:00010000:1.0:1790784311.700317:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff94590955e800/0x2c3a1e2a079d33a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d33ac expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784311.700359:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790784311.700365:0:5800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d221f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+3:5810:x1877773359518848:12345-0@lo:104: Request processed in 61us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784311.700371:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1790784311.701115:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790784311.701123:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff945900031c00/0x2c3a1e2a079d3415 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d341c expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.701132:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900031c00 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:0.0:1790784311.701137:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff945900031c00/0x2c3a1e2a079d3415 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d341c expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.701146:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff945900031c00/0x2c3a1e2a079d3415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d341c expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790784311.701170:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff945900031c00/0x2c3a1e2a079d3415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d341c expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790784311.701176:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790784311.701220:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff945900031c00/0x2c3a1e2a079d3415 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d341c expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.701227:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790784311.701260:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff945900031c00/0x2c3a1e2a079d3415 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d341c expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.701268:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff945900031c00/0x2c3a1e2a079d3415 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d341c expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.701283:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790784311.701286:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff94590955e800/0x2c3a1e2a079d33a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d33ac expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.701292:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955e800 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:0.0:1790784311.701295:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff94590955e800/0x2c3a1e2a079d33a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d33ac expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.701302:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff94590955e800/0x2c3a1e2a079d33a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d33ac expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790784311.701308:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff94590955e800/0x2c3a1e2a079d33a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d33ac expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790784311.701312:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790784311.701331:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff94590955e800/0x2c3a1e2a079d33a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d33ac expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.701336:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790784311.701347:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff94590955e800/0x2c3a1e2a079d33a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d33ac expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.701353:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff94590955e800/0x2c3a1e2a079d33a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d33ac expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.701364:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784311.701366:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784311.701368:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784311.701403:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784311.701792:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359518976:0@lo:103: 00000100:00100000:2.0:1790784311.701841:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784311.701910:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359518976 00000100:00100000:0.0:1790784311.701915:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359518976 00010000:00010000:0.0:1790784311.701938:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff945909575400/0x2c3a1e2a079d341c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3415 expref: 13 pid: 5812 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784311.701963:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790784311.701970:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:3282:x1877773359518976:12345-0@lo:103: 00010000:00010000:0.0:1790784311.701980:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784311.701985:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff945909575400/0x2c3a1e2a079d341c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3415 expref: 13 pid: 5812 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.701996:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff945909575400/0x2c3a1e2a079d341c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3415 expref: 13 pid: 5812 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.702012:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790784311.702039:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:3282:x1877773359518976:12345-0@lo:103: Request processed in 70us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784311.702053:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1790784311.702333:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff945901524400/0x2c3a1e2a079d3390 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d3389 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784311.702344:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff945901524400/0x2c3a1e2a079d3390 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3389 expref: 12 pid: 5811 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784311.702353:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d223100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5810:1877773359519232:0@lo:104: 00000100:00100000:3.0:1790784311.702631:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784311.702689:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592d01d180 going to sleep for 11 seconds 00010000:00010000:3.0:1790784311.702708:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945909575400/0x2c3a1e2a079d341c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d3415 expref: 12 pid: 5812 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784311.702718:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d220380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5810:1877773359518720:0@lo:104: 00000100:00100000:3.0:1790784311.702727:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d220000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5810:1877773359518848:0@lo:104: 00000100:00100000:2.0:1790784311.702791:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359518976:0@lo:103: 00000100:00100000:2.0:1790784311.702818:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359519104:0@lo:103: 00000100:00100000:2.0:1790784311.702841:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784311.702961:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359519104 00000100:00100000:0.0:1790784311.702966:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359519104 00010000:00010000:0.0:1790784311.702984:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff945909575200/0x2c3a1e2a079d33ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d33a5 expref: 12 pid: 5811 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784311.703013:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790784311.703020:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:3279:x1877773359519104:12345-0@lo:103: 00010000:00010000:0.0:1790784311.703029:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784311.703033:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff945909575200/0x2c3a1e2a079d33ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d33a5 expref: 12 pid: 5811 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.703042:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff945909575200/0x2c3a1e2a079d33ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d33a5 expref: 12 pid: 5811 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.703053:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945909575200/0x2c3a1e2a079d33ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d33a5 expref: 12 pid: 5811 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.703062:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790784311.703099:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+11:3279:x1877773359519104:12345-0@lo:103: Request processed in 79us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784311.703105:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790784311.703157:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359519104:0@lo:103: 00000100:00100000:1.0:1790784311.703217:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359519232 00000100:00100000:1.0:1790784311.703222:0:5800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359519232 00000100:00100000:1.0:1790784311.703341:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790784311.703349:0:5800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d221c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+3:5810:x1877773359519232:12345-0@lo:104: 00010000:00010000:1.0:1790784311.703358:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d3389 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d3390 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784311.703632:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790784311.703638:0:5800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d221c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+3:5810:x1877773359519232:12345-0@lo:104: Request processed in 291us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784311.703645:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1790784311.703681:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790784311.703687:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d3389 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d3390 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.703693:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955ea00 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:0.0:1790784311.703698:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d3389 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d3390 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.703720:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d3389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d3390 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790784311.703727:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d3389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d3390 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790784311.703733:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790784311.703756:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d3389 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3390 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.703763:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790784311.703777:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d3389 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3390 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.703784:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d3389 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3390 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.703798:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784311.703800:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784311.703801:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784311.703813:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790784311.703820:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359519360:0@lo:103: 00000100:00100000:0.0:1790784311.703844:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784311.703864:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359519360 00000100:00100000:0.0:1790784311.703868:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359519360 00010000:00010000:0.0:1790784311.703881:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff945901524400/0x2c3a1e2a079d3390 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3389 expref: 11 pid: 5811 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784311.703910:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790784311.703917:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+11:3279:x1877773359519360:12345-0@lo:103: 00010000:00010000:0.0:1790784311.703931:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784311.703935:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff945901524400/0x2c3a1e2a079d3390 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3389 expref: 11 pid: 5811 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.703945:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff945901524400/0x2c3a1e2a079d3390 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3389 expref: 11 pid: 5811 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.703957:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff945901524800/0x2c3a1e2a079d3477 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.703965:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945901524800/0x2c3a1e2a079d3477 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.703978:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff945901524800/0x2c3a1e2a079d3477 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.703985:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff945901524800/0x2c3a1e2a079d3477 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.703992:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff945901524800/0x2c3a1e2a079d3477 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.703998:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff945901524800/0x2c3a1e2a079d3477 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.704003:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901524800 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:0.0:1790784311.704006:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff945901524800/0x2c3a1e2a079d3477 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.704013:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff945901524800/0x2c3a1e2a079d3477 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.704032:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff945901524800/0x2c3a1e2a079d3477 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.704041:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790784311.704067:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+11:3279:x1877773359519360:12345-0@lo:103: Request processed in 150us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784311.704073:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790784311.704095:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359519360:0@lo:103: 00010000:00010000:3.0:1790784311.704203:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945901524400/0x2c3a1e2a079d3390 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d3389 expref: 10 pid: 5811 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784311.704213:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d223100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5810:1877773359519232:0@lo:104: 00010000:00010000:3.0:1790784311.704228:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff945901524800/0x2c3a1e2a079d3477 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784311.704247:0:5810:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff945901524800/0x2c3a1e2a079d3477 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784311.704254:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff945901524800/0x2c3a1e2a079d3477 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784311.704259:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945901524800/0x2c3a1e2a079d3477 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790784311.704276:0:5810:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1790784311.769052:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+9:6665:x1877773359518592:12345-0@lo:253: Request processed in 107668us (107984us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784311.769066:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790784311.769180:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d220e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359518592:0@lo:253: 10000000:01000000:3.0:1790784311.769194:0:6665:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1790784311.769198:0:6665:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790784311.769200:0:6665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790784311.769201:0:6665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790784311.769203:0:6665:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1790784311.769204:0:6665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790784311.769205:0:6665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790784311.769207:0:6665:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790784311.769208:0:6665:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1790784311.769209:0:6665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790784311.769210:0:6665:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790784311.769228:0:6665:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9459050db000 from lustre-OST0000 10000000:01000000:3.0:1790784311.769319:0:6665:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1790784311.769323:0:6665:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1790784311.769330:0:6665:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9459057499c0 local copy 10000000:01000000:3.0:1790784311.769334:0:6665:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790784311.769369:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945901524800/0x2c3a1e2a079d347e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784311.769474:0:6665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.132@tcp lock: ffff945901524800/0x2c3a1e2a079d347e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784311.769483:0:6665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff945901524800/0x2c3a1e2a079d347e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784311.769755:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d220e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359519488:0@lo:101: 00000100:00100000:2.0:1790784311.769792:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784311.769879:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592d01d180 going to sleep for 11 seconds 00000100:00100000:0.0:1790784311.770078:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359519488 00000100:00100000:0.0:1790784311.770085:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359519488 00000100:00100000:0.0:1790784311.770156:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790784311.770166:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+9:6665:x1877773359519488:12345-0@lo:101: 00010000:00010000:0.0:1790784311.770178:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784311.770191:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945900031c00/0x2c3a1e2a079d3485 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d347e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.770212:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945900031c00/0x2c3a1e2a079d3485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d347e expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.770222:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945900031c00/0x2c3a1e2a079d3485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d347e expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.770230:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945900031c00, rc 0) 00000100:00100000:0.0:1790784311.770282:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+10:6665:x1877773359519488:12345-0@lo:101: Request processed in 118us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784311.770288:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790784311.770354:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d220e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359519488:0@lo:101: 00010000:00010000:3.0:1790784311.770366:0:6665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff945901524800/0x2c3a1e2a079d347e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2c3a1e2a079d3485 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784311.770410:0:6665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff945901524800/0x2c3a1e2a079d347e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2c3a1e2a079d3485 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784311.770496:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d220e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359519616:0@lo:501: 00000100:00100000:3.0:1790784311.770520:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784311.770842:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459050a9240 going to sleep for 11 seconds 00000100:00100000:2.0:1790784311.770994:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359519616 00000100:00100000:2.0:1790784311.771000:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359519616 00000100:00100000:2.0:1790784311.771024:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790784311.771030:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903694c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+10:6665:x1877773359519616:12345-0@lo:501: 00000100:00100000:2.0:1790784311.771226:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903694c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+10:6665:x1877773359519616:12345-0@lo:501: Request processed in 195us (704us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790784311.771242:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790784311.771363:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d220e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359519616:0@lo:501: 10000000:01000000:3.0:1790784311.771405:0:6665:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790784311.771430:0:6665:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.132@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790784311.771436:0:6665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945901524800/0x2c3a1e2a079d347e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2c3a1e2a079d3485 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784311.771446:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945901524800/0x2c3a1e2a079d347e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2c3a1e2a079d3485 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784311.771454:0:6665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.132@tcp lock: ffff945901524800/0x2c3a1e2a079d347e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2c3a1e2a079d3485 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784311.771468:0:6665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790784311.771485:0:6665:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9459050db000 10000000:01000000:3.0:1790784311.771489:0:6665:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790784311.771493:0:6665:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9459057499c0 10000000:01000000:3.0:1790784311.771496:0:6665:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1790784311.771499:0:6665:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9459057499c0 from 1 10000000:01000000:3.0:1790784311.771502:0:6665:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1790784311.771521:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945901524400/0x2c3a1e2a079d348c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784311.771541:0:6665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff945901524400/0x2c3a1e2a079d348c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784311.771562:0:6665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff945901524400/0x2c3a1e2a079d348c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784311.771576:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d220e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359519744:0@lo:101: 00000100:00100000:3.0:1790784311.771614:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784311.771754:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459050a9300 going to sleep for 11 seconds 00000100:00100000:3.0:1790784311.771768:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359519744 00000100:00100000:3.0:1790784311.771772:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359519744 00000100:00100000:3.0:1790784311.771792:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790784311.771798:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+10:6665:x1877773359519744:12345-0@lo:101: 00010000:00010000:3.0:1790784311.771806:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784311.771817:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945901524a00/0x2c3a1e2a079d3493 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d348c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784311.771833:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945901524a00/0x2c3a1e2a079d3493 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d348c expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784311.771843:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945901524a00/0x2c3a1e2a079d3493 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d348c expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784311.771851:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945901524a00, rc 0) 00000100:00100000:3.0:1790784311.771878:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+11:6665:x1877773359519744:12345-0@lo:101: Request processed in 80us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784311.771884:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790784311.771992:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d220e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359519744:0@lo:101: 00010000:00010000:3.0:1790784311.772009:0:6665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff945901524400/0x2c3a1e2a079d348c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3493 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784311.772017:0:6665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff945901524400/0x2c3a1e2a079d348c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d3493 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790784311.772031:0:6665:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1790784311.772042:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945901524400/0x2c3a1e2a079d348c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3493 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784311.772049:0:6665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff945901524400/0x2c3a1e2a079d348c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3493 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790784311.772056:0:6665:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1790784311.772059:0:6665:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790784311.772063:0:6665:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1790784311.772065:0:6665:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790784311.772077:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d349a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784311.772084:0:6665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d349a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784311.772091:0:6665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d349a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784311.772101:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d220e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359519872:0@lo:101: 00000100:00100000:3.0:1790784311.772124:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784311.772137:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459050a9300 going to sleep for 11 seconds 00000100:00100000:3.0:1790784311.772149:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359519872 00000100:00100000:3.0:1790784311.772157:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359519872 00000100:00100000:3.0:1790784311.772175:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790784311.772180:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+11:6665:x1877773359519872:12345-0@lo:101: 00010000:00010000:3.0:1790784311.772187:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784311.772194:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945901524000/0x2c3a1e2a079d34a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d349a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784311.772207:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945901524000/0x2c3a1e2a079d34a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d349a expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784311.772215:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945901524000/0x2c3a1e2a079d34a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d349a expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784311.772221:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945901524000, rc 0) 00000100:00100000:3.0:1790784311.772314:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:6665:x1877773359519872:12345-0@lo:101: Request processed in 133us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784311.772321:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790784311.772350:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d220e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359519872:0@lo:101: 00010000:00010000:3.0:1790784311.772359:0:6665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d349a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d34a1 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784311.772366:0:6665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d349a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d34a1 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784311.772443:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d220e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359520000:0@lo:501: 00000100:00100000:3.0:1790784311.772477:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784311.772494:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459050a9300 going to sleep for 11 seconds 00000100:00100000:3.0:1790784311.772505:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359520000 00000100:00100000:3.0:1790784311.772508:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359520000 00000100:00100000:3.0:1790784311.772529:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790784311.772533:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:6665:x1877773359520000:12345-0@lo:501: 00010000:00010000:2.0:1790784311.772718:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790784311.772725:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff945901524800/0x2c3a1e2a079d347e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2c3a1e2a079d3485 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.772732:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901524800 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:2.0:1790784311.772735:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff945901524800/0x2c3a1e2a079d347e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2c3a1e2a079d3485 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.772743:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff945901524800/0x2c3a1e2a079d347e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x2c3a1e2a079d3485 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790784311.772759:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff945901524800/0x2c3a1e2a079d347e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x2c3a1e2a079d3485 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790784311.772764:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790784311.772782:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff945901524800/0x2c3a1e2a079d347e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2c3a1e2a079d3485 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.772788:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790784311.772805:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff945901524800/0x2c3a1e2a079d347e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2c3a1e2a079d3485 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.772812:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff945901524800/0x2c3a1e2a079d347e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2c3a1e2a079d3485 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.772824:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784311.772826:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784311.772827:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784311.772836:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359520128:0@lo:103: 00000100:00100000:2.0:1790784311.772863:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784311.773331:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359520128 00000100:00100000:2.0:1790784311.773337:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359520128 00000100:00100000:2.0:1790784311.773368:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790784311.773407:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:3281:x1877773359520128:12345-0@lo:103: 00010000:00010000:2.0:1790784311.773417:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784311.773428:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945900031c00/0x2c3a1e2a079d3485 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2c3a1e2a079d347e expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.773439:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790784311.773473:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:3281:x1877773359520128:12345-0@lo:103: Request processed in 99us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784311.773479:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790784311.773516:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359520128:0@lo:103: 00000100:00100000:3.0:1790784311.773798:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+11:6665:x1877773359520000:12345-0@lo:501: Request processed in 1263us (1319us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784311.773806:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790784311.773906:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d220e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359520000:0@lo:501: 00000100:00100000:2.0:1790784311.773938:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359520256:0@lo:503: 00000100:00100000:2.0:1790784311.773973:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784311.774001:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910ff90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790784311.774092:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359520256 00000100:00100000:3.0:1790784311.774096:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359520256 00000100:00100000:3.0:1790784311.774115:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790784311.774121:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+11:6665:x1877773359520256:12345-0@lo:503: 00000100:00100000:3.0:1790784311.774274:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+11:6665:x1877773359520256:12345-0@lo:503: Request processed in 152us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784311.774281:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790784311.774502:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359520256:0@lo:503: 00000040:00080000:2.0:1790784311.774958:0:6665:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790784311.775013:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359520384:0@lo:502: 00000100:00100000:2.0:1790784311.775049:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784311.775072:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910ff90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790784311.775130:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359520384 00000100:00100000:3.0:1790784311.775135:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359520384 00000100:00100000:3.0:1790784311.775167:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790784311.775174:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+11:6665:x1877773359520384:12345-0@lo:502: 00000100:00100000:3.0:1790784311.775444:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+11:6665:x1877773359520384:12345-0@lo:502: Request processed in 270us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784311.775451:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790784311.775544:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359520384:0@lo:502: 00000040:00080000:2.0:1790784311.776038:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1790784311.776085:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1790784311.776118:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1790784311.776163:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1790784311.776199:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1790784311.776231:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1790784311.776321:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359520512:0@lo:502: 00000100:00100000:2.0:1790784311.776359:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784311.776430:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910ff90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790784311.776542:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359520512 00000100:00100000:0.0:1790784311.776680:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359520512 00000100:00100000:0.0:1790784311.776720:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790784311.776727:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+11:6665:x1877773359520512:12345-0@lo:502: 00000100:00100000:0.0:1790784311.776874:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+11:6665:x1877773359520512:12345-0@lo:502: Request processed in 146us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784311.776882:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790784311.777058:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359520512:0@lo:502: 00000040:00080000:2.0:1790784311.777137:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1790784311.777147:0:6665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1790784311.777835:0:6684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790784311.777843:0:6684:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1790784311.777848:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784311.777851:0:6684:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1790784311.777855:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790784311.777868:0:6684:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff94593c4a3380) 00000020:00000080:2.0:1790784311.777954:0:6684:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1790784311.777962:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790784311.778034:0:6684:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9459050db000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1790784311.778042:0:6684:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790784311.778048:0:6684:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2c3a1e2a079d34af 00010000:00010000:2.0:1790784311.784148:0:6684:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1790784311.784877:0:6684:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1790784311.789530:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1790784311.790148:0:6684:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1790784311.798846:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1790784311.800358:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1790784311.802137:0:6684:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1790784311.802148:0:6684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790784311.802154:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790784311.802156:0:6684:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1790784311.802160:0:6684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790784311.802164:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790784311.802165:0:6684:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790784311.802168:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790784311.802170:0:6684:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790784311.802216:0:6684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790784311.802220:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790784311.802221:0:6684:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790784311.802225:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00010000:00010000:0.0:1790784311.805843:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1790784311.806037:0:6665:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1790784311.806071:0:6665:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1790784311.806094:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d349a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d34a1 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784311.806106:0:6665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d349a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d34a1 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790784311.807026:0:6665:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9459050db000 from 1 10000000:01000000:0.0:1790784311.807032:0:6665:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790784311.807067:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945900031c00/0x2c3a1e2a079d34b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.807076:0:6665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff945900031c00/0x2c3a1e2a079d34b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.807087:0:6665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff945900031c00/0x2c3a1e2a079d34b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784311.807115:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359520640:0@lo:101: 00000100:00100000:0.0:1790784311.807175:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784311.807274:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910384f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790784311.808831:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359520640 00000100:00100000:2.0:1790784311.808841:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359520640 00000100:00100000:2.0:1790784311.809062:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790784311.809072:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903696c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+11:6665:x1877773359520640:12345-0@lo:101: 00010000:00010000:2.0:1790784311.809087:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784311.809102:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945909575200/0x2c3a1e2a079d34bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d34b6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.809126:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945909575200/0x2c3a1e2a079d34bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d34b6 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.809138:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945909575200/0x2c3a1e2a079d34bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d34b6 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.809146:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945909575200, rc 0) 00000100:00100000:2.0:1790784311.809211:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903696c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:6665:x1877773359520640:12345-0@lo:101: Request processed in 141us (2035us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784311.809227:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790784311.811536:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359520640:0@lo:101: 00010000:00010000:0.0:1790784311.811575:0:6665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff945900031c00/0x2c3a1e2a079d34b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d34bd expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.811595:0:6665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff945900031c00/0x2c3a1e2a079d34b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d34bd expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784311.811713:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359520768:0@lo:501: 00000100:00100000:0.0:1790784311.811766:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784311.812138:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910384f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790784311.812211:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359520768 00000100:00100000:3.0:1790784311.812225:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359520768 00000100:00100000:3.0:1790784311.812258:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790784311.812267:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903694850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:6665:x1877773359520768:12345-0@lo:501: 00000100:00100000:3.0:1790784311.812506:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903694850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:6665:x1877773359520768:12345-0@lo:501: Request processed in 239us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784311.812513:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790784311.812744:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359520768:0@lo:501: 00000100:00100000:0.0:1790784311.812774:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359520896:0@lo:503: 00000100:00100000:0.0:1790784311.812811:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784311.812828:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910384f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790784311.812878:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359520896 00000100:00100000:3.0:1790784311.812882:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359520896 00000100:00100000:3.0:1790784311.812911:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790784311.812917:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:6665:x1877773359520896:12345-0@lo:503: 00000100:00100000:3.0:1790784311.813163:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:6665:x1877773359520896:12345-0@lo:503: Request processed in 245us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784311.813169:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790784311.813303:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359520896:0@lo:503: 00000040:00080000:0.0:1790784311.813580:0:6665:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790784311.813666:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359521024:0@lo:502: 00000100:00100000:0.0:1790784311.813702:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784311.813721:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459181813c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790784311.813879:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359521024 00000100:00100000:3.0:1790784311.813942:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359521024 00000100:00100000:3.0:1790784311.813966:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790784311.813974:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:6665:x1877773359521024:12345-0@lo:502: 00000100:00100000:3.0:1790784311.814136:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:6665:x1877773359521024:12345-0@lo:502: Request processed in 162us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784311.814142:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790784311.814219:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359521024:0@lo:502: 00000040:00080000:0.0:1790784311.814487:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1790784311.814536:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1790784311.814572:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359521152:0@lo:502: 00000100:00100000:0.0:1790784311.814615:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784311.814746:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459181813c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790784311.814797:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359521152 00000100:00100000:3.0:1790784311.814802:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359521152 00000100:00100000:3.0:1790784311.814822:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790784311.814827:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:6665:x1877773359521152:12345-0@lo:502: 00000100:00100000:3.0:1790784311.815023:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:6665:x1877773359521152:12345-0@lo:502: Request processed in 194us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784311.815030:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790784311.815107:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359521152:0@lo:502: 00000040:00080000:0.0:1790784311.815179:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1790784311.815188:0:6665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1790784311.815824:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790784311.815833:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790784311.815836:0:6688:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790784311.815843:0:6688:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9459050db000 00000020:00000080:3.0:1790784311.815845:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790784311.815863:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790784311.815866:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790784311.815868:0:6688:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1790784311.815870:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1790784311.816065:0:6665:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1790784311.816081:0:6665:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790784311.816100:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945900031c00/0x2c3a1e2a079d34b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d34bd expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.816111:0:6665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff945900031c00/0x2c3a1e2a079d34b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d34bd expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790784311.816147:0:6665:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790784311.816151:0:6665:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9459050db000 10000000:01000000:0.0:1790784311.816154:0:6665:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9459050db000 10000000:01000000:0.0:1790784311.816157:0:6665:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790784311.816162:0:6665:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9459050db000 from 1 10000000:01000000:0.0:1790784311.816165:0:6665:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790784311.816189:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d34c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.816198:0:6665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d34c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.816207:0:6665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d34c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784311.816232:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359521280:0@lo:101: 00000100:00100000:0.0:1790784311.816269:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784311.816290:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910384f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790784311.816346:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359521280 00000100:00100000:2.0:1790784311.816351:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359521280 00000100:00100000:2.0:1790784311.816402:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790784311.816409:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:6665:x1877773359521280:12345-0@lo:101: 00010000:00010000:2.0:1790784311.816419:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784311.816431:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945909575400/0x2c3a1e2a079d34cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d34c4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.816451:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945909575400/0x2c3a1e2a079d34cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d34c4 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.816460:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945909575400/0x2c3a1e2a079d34cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d34c4 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.816468:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945909575400, rc 0) 00000100:00100000:2.0:1790784311.816503:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:6665:x1877773359521280:12345-0@lo:101: Request processed in 94us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784311.816509:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790784311.816621:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359521280:0@lo:101: 00010000:00010000:0.0:1790784311.816642:0:6665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d34c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d34cb expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.816651:0:6665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d34c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d34cb expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784311.816713:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359521408:0@lo:501: 00000100:00100000:0.0:1790784311.816737:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784311.816753:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910384f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790784311.816967:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359521408 00000100:00100000:2.0:1790784311.816972:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359521408 00000100:00100000:2.0:1790784311.816990:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790784311.816996:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:6665:x1877773359521408:12345-0@lo:501: 00000100:00100000:2.0:1790784311.817181:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:6665:x1877773359521408:12345-0@lo:501: Request processed in 184us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784311.817188:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790784311.817302:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359521408:0@lo:501: 00000100:00100000:0.0:1790784311.817324:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359521536:0@lo:503: 00000100:00100000:0.0:1790784311.817357:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784311.817408:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910384f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790784311.817481:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359521536 00000100:00100000:2.0:1790784311.817486:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359521536 00000100:00100000:2.0:1790784311.817519:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790784311.817526:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:6665:x1877773359521536:12345-0@lo:503: 00000100:00100000:2.0:1790784311.817802:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:6665:x1877773359521536:12345-0@lo:503: Request processed in 276us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784311.817809:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790784311.817873:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359521536:0@lo:503: 00000040:00080000:0.0:1790784311.818161:0:6665:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790784311.818228:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359521664:0@lo:502: 00000100:00100000:0.0:1790784311.818265:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784311.818323:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff945920ed8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790784311.818397:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359521664 00000100:00100000:1.0:1790784311.818401:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359521664 00000100:00100000:3.0:1790784311.818530:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790784311.818765:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:6665:x1877773359521664:12345-0@lo:502: 00000100:00100000:0.0:1790784311.819055:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:6665:x1877773359521664:12345-0@lo:502: Request processed in 516us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784311.819069:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790784311.819189:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359521664:0@lo:502: 00000040:00080000:2.0:1790784311.819752:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1790784311.819804:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1790784311.819835:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1790784311.819875:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1790784311.819983:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1790784311.820032:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1790784311.820068:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1790784311.820110:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1790784311.820157:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1790784311.820191:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1790784311.820225:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1790784311.820269:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1790784311.820304:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1790784311.820339:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1790784311.820712:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1790784311.820751:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1790784311.820781:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1790784311.820829:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1790784311.820865:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1790784311.820974:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1790784311.821039:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1790784311.821079:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1790784311.821114:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1790784311.821185:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1790784311.821222:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1790784311.821263:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1790784311.821311:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1790784311.821348:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1790784311.821746:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359521792:0@lo:502: 00000100:00100000:2.0:1790784311.821814:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784311.821966:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910ff93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790784311.822014:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359521792 00000100:00100000:0.0:1790784311.822021:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359521792 00000100:00100000:0.0:1790784311.822098:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790784311.822107:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:6665:x1877773359521792:12345-0@lo:502: 00000100:00100000:0.0:1790784311.822308:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:6665:x1877773359521792:12345-0@lo:502: Request processed in 202us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784311.822316:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790784311.822432:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359521792:0@lo:502: 00000040:00080000:2.0:1790784311.822501:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1790784311.822512:0:6665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1790784311.823225:0:6689:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1790784311.823240:0:6689:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff94593c4a0000) 00000020:00000080:2.0:1790784311.823258:0:6689:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1790784311.823322:0:6689:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9459050db000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790784311.823326:0:6689:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9459050db000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790784311.823328:0:6689:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9459050db000 3 00010000:00080000:2.0:1790784311.823365:0:6689:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94593f687000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.132@tcp at head 00010000:00010000:0.0:1790784311.827002:0:6689:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1790784311.827248:0:6689:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1790784311.827283:0:6689:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790784311.827294:0:6689:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2c3a1e2a079d34d9 00000100:00080000:0.0:1790784311.827303:0:6689:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790784311.827312:0:6689:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff94593f687000 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:0.0:1790784311.827344:0:6689:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9459057c3b80 x1877773359521920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790784311.827372:0:6689:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790784311.827727:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3278:1877773359521920:0@lo:38: 00000100:00100000:2.0:1790784311.827787:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784311.827847:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359521920 00000100:00100000:2.0:1790784311.827854:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359521920 00000100:00100000:2.0:1790784311.827882:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790784311.827902:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3278:x1877773359521920:12345-0@lo:38: 00010000:00080000:2.0:1790784311.827934:0:5820:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 145 last 0 00000020:00000080:2.0:1790784311.827961:0:5820:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2c3a1e2a079d34e0 00000004:00100000:2.0:1790784311.827975:0:5820:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790784311.828001:0:5820:0:(import.c:65:import_set_state_nolock()) ffff94593f684000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790784311.828045:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1877773359521920:12345-0@lo:38: Request processed in 142us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784311.828061:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790784311.828099:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9459057c3b80 x1877773359521920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790784321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790784311.828110:0:3278:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790784311.828116:0:3278:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1790784311.828122:0:3278:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790784311.828125:0:3278:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790784311.828128:0:3278:0:(import.c:65:import_set_state_nolock()) ffff94593f687000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790784311.828133:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3278:1877773359521920:0@lo:38: 00000040:00080000:0.0:1790784311.828254:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1790784311.828521:0:6665:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1790784311.828553:0:6665:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790784311.828571:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d34c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d34cb expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.828581:0:6665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d34c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d34cb expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790784311.828729:0:6665:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790784311.828732:0:6665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790784311.828734:0:6665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790784311.828735:0:6665:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790784311.828736:0:6665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790784311.828738:0:6665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790784311.828740:0:6665:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790784311.828741:0:6665:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790784311.828743:0:6665:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790784311.828744:0:6665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790784311.828745:0:6665:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790784311.828749:0:6665:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1790784311.828751:0:6665:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790784311.828757:0:6665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790784311.828758:0:6665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790784311.828759:0:6665:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790784311.828760:0:6665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790784311.828761:0:6665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790784311.828762:0:6665:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790784311.828763:0:6665:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790784311.828764:0:6665:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790784311.828766:0:6665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790784311.828767:0:6665:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790784311.828781:0:6665:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790784311.828791:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359522048:0@lo:253: 00000100:00100000:2.0:1790784311.828834:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784311.828856:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910ff9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790784311.828970:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359522048 00000100:00100000:0.0:1790784311.828975:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359522048 00000100:00100000:0.0:1790784311.829012:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790784311.829019:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:6665:x1877773359522048:12345-0@lo:253: 20000000:01000000:0.0:1790784311.829039:0:5811:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790784311.829050:0:5811:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1790784311.829787:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1877773359522176:0@lo:400: 00000100:00100000:3.0:1790784311.829828:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784311.829866:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359522176 00000100:00100000:3.0:1790784311.829870:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359522176 00000100:00100000:3.0:1790784311.829911:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790784311.829918:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1877773359522176:12345-0@lo:400: 00000100:00100000:3.0:1790784311.829956:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1877773359522176:12345-0@lo:400: Request processed in 38us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784311.829962:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790784311.830013:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94592d223100 x1877773359522176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790784327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784311.830024:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1877773359522176:0@lo:400: 20000000:01000000:0.0:1790784311.860405:0:5811:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790784311.860418:0:5811:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1790784311.860466:0:5834:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790784311.860471:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790784311.860490:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff945909575e00/0x2c3a1e2a079d34e7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.860508:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff945901525e00/0x2c3a1e2a079d343f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3438 expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.860516:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff945909575e00/0x2c3a1e2a079d34e7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.860550:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff945901525e00/0x2c3a1e2a079d343f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d3438 expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.860643:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff945901525e00/0x2c3a1e2a079d343f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3438 expref: 13 pid: 5812 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784311.860658:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5834:1877773359522304:0@lo:104: 00000100:00100000:2.0:1790784311.860711:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784311.860758:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910ff9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790784311.861258:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359522304 00000100:00100000:0.0:1790784311.861270:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359522304 00000100:00100000:0.0:1790784311.861319:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790784311.861328:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+3:5834:x1877773359522304:12345-0@lo:104: 00010000:00010000:0.0:1790784311.861340:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff945909574c00/0x2c3a1e2a079d3438 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d343f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784311.861416:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790784311.861421:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+3:5834:x1877773359522304:12345-0@lo:104: Request processed in 96us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784311.861428:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1790784311.861648:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790784311.861654:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff945909574c00/0x2c3a1e2a079d3438 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d343f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.861661:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945909574c00 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:2.0:1790784311.861665:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff945909574c00/0x2c3a1e2a079d3438 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d343f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.861673:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff945909574c00/0x2c3a1e2a079d3438 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d343f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790784311.861680:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff945909574c00/0x2c3a1e2a079d3438 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d343f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790784311.861686:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790784311.861715:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff945909574c00/0x2c3a1e2a079d3438 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d343f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.861721:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790784311.861739:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff945909574c00/0x2c3a1e2a079d3438 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d343f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.861745:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff945909574c00/0x2c3a1e2a079d3438 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d343f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.861761:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784311.861763:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784311.861764:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784311.861777:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359522432:0@lo:103: 00000100:00100000:2.0:1790784311.861810:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784311.861851:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359522432 00000100:00100000:2.0:1790784311.861861:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359522432 00010000:00010000:2.0:1790784311.861877:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff945901525e00/0x2c3a1e2a079d343f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3438 expref: 14 pid: 5812 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784311.862349:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790784311.862357:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905195850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:3279:x1877773359522432:12345-0@lo:103: 00010000:00010000:2.0:1790784311.862367:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784311.862399:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff945901525e00/0x2c3a1e2a079d343f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3438 expref: 14 pid: 5812 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.862412:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff945901525e00/0x2c3a1e2a079d343f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3438 expref: 14 pid: 5812 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.862428:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff945909575e00/0x2c3a1e2a079d34e7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.862435:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945909575e00/0x2c3a1e2a079d34e7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790784311.862448:0:5804:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002816997s 00010000:00010000:2.0:1790784311.862453:0:5804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff945909575e00/0x2c3a1e2a079d34e7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.862461:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff945909575e00/0x2c3a1e2a079d34e7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.862468:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff945909575e00/0x2c3a1e2a079d34e7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.862474:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff945909575e00/0x2c3a1e2a079d34e7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.862490:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945909575e00 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:2.0:1790784311.862494:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff945909575e00/0x2c3a1e2a079d34e7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.862502:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff945909575e00/0x2c3a1e2a079d34e7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.862511:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff945909575e00/0x2c3a1e2a079d34e7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.862520:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790784311.863102:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905195850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:3279:x1877773359522432:12345-0@lo:103: Request processed in 744us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784311.863110:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1790784311.863181:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945901525e00/0x2c3a1e2a079d343f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d3438 expref: 13 pid: 5812 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784311.863195:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5834:1877773359522304:0@lo:104: 00010000:00010000:2.0:1790784311.863210:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff945909575e00/0x2c3a1e2a079d34e7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.863218:0:5834:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff945909575e00/0x2c3a1e2a079d34e7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.863224:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff945909575e00/0x2c3a1e2a079d34e7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784311.863229:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945909575e00/0x2c3a1e2a079d34e7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784311.866309:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359522432:0@lo:103: 00000100:00100000:2.0:1790784311.869305:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:6665:x1877773359522048:12345-0@lo:253: Request processed in 40280us (40464us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784311.869320:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790784311.869510:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6665:1877773359522048:0@lo:253: 10000000:01000000:3.0:1790784311.869524:0:6665:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1790784311.869527:0:6665:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790784311.869529:0:6665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790784311.869530:0:6665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790784311.869532:0:6665:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790784311.869533:0:6665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790784311.869559:0:6665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790784311.869561:0:6665:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790784311.869562:0:6665:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790784311.869564:0:6665:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790784311.869565:0:6665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790784311.869567:0:6665:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790784311.869579:0:6665:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1790784311.874722:0:6665:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1790784311.874957:0:6665:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1790784311.875147:0:6665:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1790784311.875300:0:6665:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1790784311.875779:0:6665:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1790784311.876100:0:6665:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1790784311.877514:0:6665:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1790784312.133296:0:6665:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1790784312.133303:0:6665:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1790784312.133336:0:6665:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790784312.133419:0:6665:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.132@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790784312.133436:0:6665:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1790784312.133451:0:6665:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1790784312.829767:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790784313.596268:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790784313.596273:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff945905fd5000 from 21 10000000:01000000:3.0:1790784313.596278:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790784313.596319:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945901525800/0x2c3a1e2a079d34ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784313.596331:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff945901525800/0x2c3a1e2a079d34ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784313.596342:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff945901525800/0x2c3a1e2a079d34ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784313.596364:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d223100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359522560:0@lo:101: 00000100:00100000:3.0:1790784313.596744:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784313.596794:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff945903bc5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790784313.596996:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359522560 00000100:00100000:2.0:1790784313.597004:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359522560 00000100:00100000:2.0:1790784313.597059:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790784313.597164:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:5815:x1877773359522560:12345-0@lo:101: 00010000:00010000:2.0:1790784313.597179:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784313.597193:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945909575e00/0x2c3a1e2a079d34f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d34ee expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784313.597218:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945909575e00/0x2c3a1e2a079d34f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d34ee expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784313.597229:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945909575e00/0x2c3a1e2a079d34f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d34ee expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784313.597238:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945909575e00, rc 0) 00000100:00100000:2.0:1790784313.597287:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:5815:x1877773359522560:12345-0@lo:101: Request processed in 220us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784313.597294:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790784313.597446:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d223100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359522560:0@lo:101: 00010000:00010000:0.0:1790784313.597461:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff945901525800/0x2c3a1e2a079d34ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d34f5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784313.597471:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff945901525800/0x2c3a1e2a079d34ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d34f5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784313.597526:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359522688:0@lo:501: 00000100:00100000:0.0:1790784313.597553:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784313.597572:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff945906b72e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790784313.599270:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359522688 00000100:00100000:2.0:1790784313.599287:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359522688 00000100:00100000:2.0:1790784313.599331:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790784313.599340:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:5815:x1877773359522688:12345-0@lo:501: 00000100:00100000:2.0:1790784313.599736:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:5815:x1877773359522688:12345-0@lo:501: Request processed in 395us (2180us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784313.599744:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790784313.599871:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359522688:0@lo:501: 00000100:00100000:0.0:1790784313.599913:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359522816:0@lo:503: 00000100:00100000:0.0:1790784313.599955:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784313.599992:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff945906b72e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790784313.600164:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359522816 00000100:00100000:2.0:1790784313.600169:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359522816 00000100:00100000:2.0:1790784313.600205:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790784313.600213:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:5815:x1877773359522816:12345-0@lo:503: 00000100:00100000:2.0:1790784313.600503:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:5815:x1877773359522816:12345-0@lo:503: Request processed in 291us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784313.600511:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790784313.600666:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359522816:0@lo:503: 00000100:00100000:0.0:1790784313.604782:0:6771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6771:1877773359522944:0@lo:502: 00000100:00100000:0.0:1790784313.604933:0:6771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784313.605005:0:6771:0:(client.c:2716:ptlrpc_set_wait()) set ffff945906b72480 going to sleep for 11 seconds 00000100:00100000:1.0:1790784313.605049:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359522944 00000100:00100000:1.0:1790784313.605062:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359522944 00000100:00100000:1.0:1790784313.605216:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790784313.605225:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:6771:x1877773359522944:12345-0@lo:502: 00000100:00100000:1.0:1790784313.605609:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:6771:x1877773359522944:12345-0@lo:502: Request processed in 385us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784313.605617:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790784313.605714:0:6771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6771:1877773359522944:0@lo:502: 00000100:00100000:0.0:1790784313.605763:0:6771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6771:1877773359523072:0@lo:502: 00000100:00100000:0.0:1790784313.605798:0:6771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784313.605918:0:6771:0:(client.c:2716:ptlrpc_set_wait()) set ffff945906b72480 going to sleep for 11 seconds 00000100:00100000:1.0:1790784313.605955:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359523072 00000100:00100000:1.0:1790784313.605960:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359523072 00000100:00100000:1.0:1790784313.605992:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790784313.605999:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:6771:x1877773359523072:12345-0@lo:502: 00000100:00100000:1.0:1790784313.606259:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:6771:x1877773359523072:12345-0@lo:502: Request processed in 259us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784313.606266:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790784313.606342:0:6771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6771:1877773359523072:0@lo:502: 00000040:00080000:0.0:1790784313.606361:0:6771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1790784313.606512:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1790784313.606532:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790784313.606541:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945901525800/0x2c3a1e2a079d34ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d34f5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784313.606551:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff945901525800/0x2c3a1e2a079d34ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d34f5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790784313.606560:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790784313.606563:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff945905fd5000 from 4 10000000:01000000:1.0:1790784313.606565:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790784313.606599:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d34fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784313.606607:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d34fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784313.606627:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d34fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784313.606640:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359523200:0@lo:101: 00000100:00100000:1.0:1790784313.606669:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784313.606695:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459200bc240 going to sleep for 11 seconds 00000100:00100000:0.0:1790784313.606739:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359523200 00000100:00100000:0.0:1790784313.606744:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359523200 00000100:00100000:0.0:1790784313.606774:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790784313.606781:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:5815:x1877773359523200:12345-0@lo:101: 00010000:00010000:0.0:1790784313.606789:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784313.606801:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945900031800/0x2c3a1e2a079d3503 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d34fc expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784313.607224:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945900031800/0x2c3a1e2a079d3503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d34fc expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784313.607236:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945900031800/0x2c3a1e2a079d3503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d34fc expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784313.607244:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945900031800, rc 0) 00000100:00100000:0.0:1790784313.607326:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:5815:x1877773359523200:12345-0@lo:101: Request processed in 545us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784313.607333:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790784313.607435:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359523200:0@lo:101: 00010000:00010000:1.0:1790784313.607449:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d34fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3503 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784313.607458:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d34fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d3503 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784313.607504:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359523328:0@lo:256: 00000100:00100000:1.0:1790784313.607535:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784313.607560:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459200bc240 going to sleep for 11 seconds 00000100:00100000:0.0:1790784313.607641:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359523328 00000100:00100000:0.0:1790784313.607646:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359523328 00000100:00100000:0.0:1790784313.607670:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790784313.607677:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:5815:x1877773359523328:12345-0@lo:256: 20000000:01000000:0.0:1790784313.607694:0:5811:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790784313.607709:0:5811:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790784313.607711:0:5811:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1790784313.608009:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:5815:x1877773359523328:12345-0@lo:256: Request processed in 331us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784313.608016:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790784313.608063:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359523328:0@lo:256: 10000000:01000000:3.0:1790784313.608165:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790784313.608176:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d34fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3503 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784313.608185:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d34fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3503 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790784313.608194:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1790784313.608196:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1790784313.608198:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790784313.608219:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945901525e00/0x2c3a1e2a079d350a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784313.608227:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff945901525e00/0x2c3a1e2a079d350a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784313.608236:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff945901525e00/0x2c3a1e2a079d350a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784313.608248:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d220380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359523456:0@lo:101: 00000100:00100000:3.0:1790784313.608277:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784313.608338:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff945903bc5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790784313.608371:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359523456 00000100:00100000:0.0:1790784313.608484:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359523456 00000100:00100000:0.0:1790784313.608555:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790784313.608562:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905f9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:5815:x1877773359523456:12345-0@lo:101: 00010000:00010000:0.0:1790784313.608572:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784313.608593:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945900030000/0x2c3a1e2a079d3511 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d350a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784313.608612:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945900030000/0x2c3a1e2a079d3511 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d350a expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784313.608621:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945900030000/0x2c3a1e2a079d3511 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d350a expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784313.608629:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945900030000, rc 0) 00000100:00100000:0.0:1790784313.608668:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905f9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:5815:x1877773359523456:12345-0@lo:101: Request processed in 106us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784313.608674:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790784313.608727:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d220380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359523456:0@lo:101: 00010000:00010000:3.0:1790784313.608739:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff945901525e00/0x2c3a1e2a079d350a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3511 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784313.608747:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff945901525e00/0x2c3a1e2a079d350a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d3511 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784313.608787:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d220380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359523584:0@lo:501: 00000100:00100000:3.0:1790784313.608834:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784313.608973:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff945903bc5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790784313.609001:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359523584 00000100:00100000:1.0:1790784313.609005:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359523584 00000100:00100000:1.0:1790784313.609026:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790784313.609033:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905f9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:5815:x1877773359523584:12345-0@lo:501: 00000100:00100000:1.0:1790784313.609293:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905f9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:5815:x1877773359523584:12345-0@lo:501: Request processed in 260us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784313.609300:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790784313.609453:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d220380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359523584:0@lo:501: 00000100:00100000:3.0:1790784313.609479:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d220380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359523712:0@lo:503: 00000100:00100000:3.0:1790784313.609516:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784313.609538:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff945903bc5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790784313.609766:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359523712 00000100:00100000:1.0:1790784313.609772:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359523712 00000100:00100000:1.0:1790784313.609792:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790784313.609798:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:5815:x1877773359523712:12345-0@lo:503: 00000100:00100000:1.0:1790784313.610216:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:5815:x1877773359523712:12345-0@lo:503: Request processed in 417us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784313.610224:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790784313.610912:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d220380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359523712:0@lo:503: 00000100:00100000:1.0:1790784313.611273:0:6773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a73480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6773:1877773359523840:0@lo:502: 00000100:00100000:1.0:1790784313.611317:0:6773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784313.611354:0:6773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459200bc000 going to sleep for 11 seconds 00000100:00100000:3.0:1790784313.611417:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359523840 00000100:00100000:3.0:1790784313.611423:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359523840 00000100:00100000:3.0:1790784313.611460:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790784313.611467:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590564b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:6773:x1877773359523840:12345-0@lo:502: 00000100:00100000:3.0:1790784313.611708:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590564b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:6773:x1877773359523840:12345-0@lo:502: Request processed in 241us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784313.611716:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790784313.611931:0:6773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a73480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6773:1877773359523840:0@lo:502: 00000020:01000000:1.0:1790784313.611953:0:6773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790784313.611960:0:6773:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1790784313.611967:0:6773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790784313.611969:0:6773:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1790784313.611975:0:6773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790784313.611978:0:6773:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.132@tcp to nid 0x20000c0a8ce84 (192.168.206.132@tcp) 00000020:01000000:1.0:1790784313.612000:0:6773:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1790784313.612002:0:6773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790784313.612015:0:6773:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff945935d73380) 00000020:00000080:1.0:1790784313.612033:0:6773:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1790784313.612037:0:6773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790784313.612177:0:6773:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1790784313.612182:0:6773:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1790784313.612189:0:6773:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2c3a1e2a079d351f 00010000:00080000:1.0:1790784313.612227:0:6773:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94592da6d800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.132@tcp at head 00010000:00010000:1.0:1790784313.612718:0:6773:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1790784313.662212:0:6773:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1790784313.662247:0:6773:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1790784313.662854:0:6773:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790784313.663020:0:6773:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790784313.663082:0:6773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1790784313.663146:0:6773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1790784313.663964:0:6775:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790784313.663970:0:6775:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1790784313.664885:0:6773:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790784313.664897:0:6773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790784313.664930:0:6773:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1790784313.664952:0:6773:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2c3a1e2a079d3526 00000100:00080000:2.0:1790784313.664963:0:6773:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790784313.665043:0:6773:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff94592da6d800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:2.0:1790784313.665202:0:6773:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94593c29d880 x1877773359523968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790784313.665267:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1877773359523968:0@lo:8: 00000100:00100000:0.0:1790784313.665334:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784313.665399:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359523968 00000100:00100000:3.0:1790784313.665406:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359523968 00000100:00100000:3.0:1790784313.665438:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790784313.665446:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3278:x1877773359523968:12345-0@lo:8: 00010000:00080000:3.0:1790784313.665469:0:6668:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 147 last 0 00000100:00080000:2.0:1790784313.665491:0:6773:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:00000080:3.0:1790784313.665492:0:6668:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2c3a1e2a079d352d 00002000:00100000:3.0:1790784313.665520:0:6668:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff94593fa99000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1790784313.665525:0:6668:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1790784313.665528:0:6668:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:2.0:1790784313.665605:0:6773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790784313.665610:0:6773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784313.665612:0:6773:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1790784313.665614:0:6773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790784313.665618:0:6773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784313.665619:0:6773:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790784313.665628:0:6773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790784313.665629:0:6773:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00002000:00100000:3.0:1790784313.665651:0:6668:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1790784313.665662:0:6773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6773:1877773359524096:0@lo:502: 00000100:00100000:2.0:1790784313.665705:0:6773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784313.665727:0:6773:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459070683c0 going to sleep for 11 seconds 00002000:00080000:3.0:1790784313.665783:0:6668:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790784313.665805:0:6668:0:(import.c:65:import_set_state_nolock()) ffff94593fa9e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790784313.665932:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359524352:0@lo:400: 00000100:00100000:1.0:1790784313.665968:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784313.666018:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359524352 00000100:00100000:1.0:1790784313.666022:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359524352 00000100:00100000:2.0:1790784313.666180:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1877773359524224:0@lo:400: 00000100:00100000:2.0:1790784313.666207:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784313.666355:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359524224 00000100:00100000:1.0:1790784313.666366:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359524224 00000100:00100000:1.0:1790784313.666408:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790784313.666414:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906a72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1877773359524352:12345-0@lo:400: 00000100:00100000:1.0:1790784313.666540:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906a72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1877773359524352:12345-0@lo:400: Request processed in 125us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784313.666557:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790784313.666571:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790784313.666586:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1877773359524224:12345-0@lo:400: 00000100:00100000:1.0:1790784313.666620:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1877773359524224:12345-0@lo:400: Request processed in 43us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784313.666626:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1790784313.666654:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790784313.666682:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff945906a73480 x1877773359524224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790784329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790784313.666694:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1877773359524224:0@lo:400: 00000100:00100000:3.0:1790784313.666713:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3278:x1877773359523968:12345-0@lo:8: Request processed in 1266us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784313.666720:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790784313.666849:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff945906a70e00 x1877773359524352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790784329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790784313.666858:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359524352:0@lo:400: 00010000:00080000:0.0:1790784313.666910:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94593c29d880 x1877773359523968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790784323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784313.666919:0:3278:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790784313.666927:0:3278:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1790784313.666934:0:3278:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790784313.666939:0:3278:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1790784313.666941:0:3278:0:(import.c:65:import_set_state_nolock()) ffff94592da6d800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790784313.666956:0:3278:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790784313.666960:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1877773359523968:0@lo:8: 00000100:00100000:0.0:1790784313.667047:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359524096 00000100:00100000:0.0:1790784313.667051:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359524096 00000100:00100000:0.0:1790784313.667252:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790784313.667260:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:6773:x1877773359524096:12345-0@lo:502: 00000004:00080000:3.0:1790784313.667719:0:6775:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1790784313.667802:0:6775:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 147817426521ns, next at 0ns, rc = 0 00000100:00100000:0.0:1790784313.668888:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:6773:x1877773359524096:12345-0@lo:502: Request processed in 1624us (3177us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784313.668900:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790784313.669237:0:6773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:6773:1877773359524096:0@lo:502: 00000020:01000000:3.0:1790784313.669271:0:6773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790784313.669278:0:6773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790784313.669280:0:6773:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790784313.669284:0:6773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1790784313.669866:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1790784313.669884:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790784313.669894:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945901525e00/0x2c3a1e2a079d350a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3511 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784313.669920:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff945901525e00/0x2c3a1e2a079d350a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3511 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790784313.669929:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1790784313.669931:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9459057499c0 from 1 10000000:01000000:0.0:1790784313.669934:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790784313.669967:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945900030c00/0x2c3a1e2a079d3534 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784313.670509:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff945900030c00/0x2c3a1e2a079d3534 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784313.670520:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff945900030c00/0x2c3a1e2a079d3534 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784313.670539:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359524480:0@lo:101: 00000100:00100000:0.0:1790784313.670883:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784313.671131:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff94590646e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790784313.673441:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359524480 00000100:00100000:1.0:1790784313.673454:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359524480 00000100:00100000:1.0:1790784313.673543:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790784313.673563:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905648450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:5815:x1877773359524480:12345-0@lo:101: 00010000:00010000:1.0:1790784313.673601:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784313.673623:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94590955f800/0x2c3a1e2a079d353b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d3534 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784313.673657:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94590955f800/0x2c3a1e2a079d353b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3534 expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784313.673666:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94590955f800/0x2c3a1e2a079d353b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3534 expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784313.673689:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94590955f800, rc 0) 00000100:00100000:1.0:1790784313.673750:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905648450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:5815:x1877773359524480:12345-0@lo:101: Request processed in 191us (2868us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784313.673756:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790784313.674926:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359524480:0@lo:101: 00010000:00010000:1.0:1790784313.674948:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff945900030c00/0x2c3a1e2a079d3534 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d353b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784313.674959:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff945900030c00/0x2c3a1e2a079d3534 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d353b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784313.676167:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359524608:0@lo:501: 00000100:00100000:1.0:1790784313.676240:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784313.676285:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff945906b72f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790784313.677595:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359524608 00000100:00100000:2.0:1790784313.677605:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359524608 00000100:00100000:2.0:1790784313.677672:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790784313.677682:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590564a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:5815:x1877773359524608:12345-0@lo:501: 00000100:00100000:2.0:1790784313.677891:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590564a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:5815:x1877773359524608:12345-0@lo:501: Request processed in 210us (1652us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790784313.677898:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790784313.680507:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359524608:0@lo:501: 10000000:01000000:0.0:1790784313.682783:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790784313.682800:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945900030c00/0x2c3a1e2a079d3534 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d353b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784313.682814:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff945900030c00/0x2c3a1e2a079d3534 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d353b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790784313.766762:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1790784313.766821:0:6776:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1790784313.766846:0:6776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6776:1877773359524864:0@lo:7: 00000100:00100000:2.0:1790784313.766913:0:6776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784313.767006:0:6776:0:(client.c:2716:ptlrpc_set_wait()) set ffff945902ac2540 going to sleep for 11 seconds 00000100:00100000:2.0:1790784313.767049:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359524736:0@lo:13: 00000100:00100000:2.0:1790784313.767076:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784313.767431:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359524736 00000100:00100000:1.0:1790784313.767438:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359524736 00000100:00100000:1.0:1790784313.767488:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790784313.767498:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1877773359524736:12345-0@lo:13: 00002000:00000024:1.0:1790784313.767530:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1790784313.767592:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1877773359524736:12345-0@lo:13: Request processed in 96us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784313.767599:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1790784313.767619:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790784313.767703:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94593c29dc00 x1877773359524736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790784313.767721:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359524736:0@lo:13: 00000100:00100000:3.0:1790784313.781532:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359524864 00000100:00100000:3.0:1790784313.781546:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359524864 00000100:00100000:2.0:1790784313.782765:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790784313.782781:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6776:x1877773359524864:12345-0@lo:7: 00002000:00080000:2.0:1790784313.799773:0:6669:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1790784313.799782:0:6669:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1790784313.799963:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6776:x1877773359524864:12345-0@lo:7: Request processed in 17183us (33045us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784313.799974:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790784313.799992:0:6776:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94593c29ca80 x1877773359524864/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790784329 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784313.800007:0:6776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6776:1877773359524864:0@lo:7: 00000004:00080000:3.0:1790784313.800021:0:6776:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1790784313.800060:0:6776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d220380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6776:1877773359524992:0@lo:5: 00000100:00100000:3.0:1790784313.800097:0:6776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784313.800139:0:6776:0:(client.c:2716:ptlrpc_set_wait()) set ffff945935eae000 going to sleep for 11 seconds 00000100:00100000:1.0:1790784313.800228:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359524992 00000100:00100000:1.0:1790784313.800234:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359524992 00000100:00100000:1.0:1790784313.800275:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790784313.800293:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6776:x1877773359524992:12345-0@lo:5: 00002000:00080000:1.0:1790784313.800316:0:6668:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1790784313.800319:0:6668:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1790784313.800598:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6776:x1877773359524992:12345-0@lo:5: Request processed in 305us (499us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1790784313.800605:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1790784313.800641:0:6776:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94592d220380 x1877773359524992/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790784329 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790784313.800654:0:6776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d220380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6776:1877773359524992:0@lo:5: 00000004:00080000:1.0:1790784313.800663:0:6776:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1790784313.800688:0:6776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a70380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6776:1877773359525120:0@lo:700: 00000100:00100000:1.0:1790784313.800721:0:6776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784313.800738:0:6776:0:(client.c:2716:ptlrpc_set_wait()) set ffff945902d0e600 going to sleep for 11 seconds 00000100:00100000:1.0:1790784313.800758:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359525120 00000100:00100000:1.0:1790784313.800762:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359525120 00000100:00100000:1.0:1790784313.800789:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790784313.800796:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906a73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6776:x1877773359525120:12345-0@lo:700: 00000100:00100000:1.0:1790784313.800822:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a70000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6676:1877773359525248:0@lo:700: 00000100:00100000:1.0:1790784313.800850:0:6676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784313.800864:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905135c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790784313.801715:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359525248 00000100:00100000:2.0:1790784313.801723:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359525248 00000100:00100000:2.0:1790784313.801766:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790784313.801773:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6676:x1877773359525248:12345-0@lo:700: 00010000:00010000:0.0:1790784313.850734:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:2.0:1790784313.883054:0:5825:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1790784313.892500:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6676:x1877773359525248:12345-0@lo:700: Request processed in 90718us (91639us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784313.892519:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790784313.892592:0:6676:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff945906a70000 x1877773359525248/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790784329 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784313.892618:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a70000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6676:1877773359525248:0@lo:700: 40000000:02000000:3.0:1790784313.892630:0:6676:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:2.0:1790784313.966895:0:6693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1790784313.966920:0:6693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1790784313.968600:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906a73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6776:x1877773359525120:12345-0@lo:700: Request processed in 167798us (167879us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784313.968614:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790784313.969344:0:6776:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff945906a70380 x1877773359525120/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790784329 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790784313.969356:0:6776:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1790784313.973076:0:6776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a70380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6776:1877773359525120:0@lo:700: 00000004:02000040:2.0:1790784314.017668:0:6776:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1790784314.029797:0:6776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d221880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6776:1877773359525376:0@lo:5: 00000100:00100000:3.0:1790784314.029856:0:6776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784314.029905:0:6776:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593f481540 going to sleep for 11 seconds 00000100:00100000:2.0:1790784314.031202:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359525376 00000100:00100000:2.0:1790784314.031214:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359525376 00000100:00100000:2.0:1790784314.031285:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790784314.031296:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6776:x1877773359525376:12345-0@lo:5: 00002000:00080000:2.0:1790784314.040270:0:6669:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1790784314.040290:0:6669:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1790784314.046422:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6776:x1877773359525376:12345-0@lo:5: Request processed in 15121us (16558us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1790784314.046441:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790784314.046507:0:6776:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94592d221880 x1877773359525376/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790784330 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784314.046523:0:6776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d221880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6776:1877773359525376:0@lo:5: 00000004:00080000:3.0:1790784314.046537:0:6776:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1790784314.879215:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784315.898527:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784316.923979:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784317.952740:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790784318.559462:0:7037:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg632-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1790784318.906868:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359525760:0@lo:400: 00000100:00100000:1.0:1790784318.906886:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1877773359525632:0@lo:400: 00000100:00100000:3.0:1790784318.906930:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784318.906967:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359525760 00000100:00100000:1.0:1790784318.906982:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359525760 00000100:00100000:3.0:1790784318.906986:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790784318.906994:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359525888:0@lo:400: 00000100:00100000:3.0:1790784318.907023:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784318.907045:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790784318.907055:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1877773359525760:12345-0@lo:400: 00000100:00100000:3.0:1790784318.907064:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359525888 00000100:00100000:3.0:1790784318.907070:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359525888 00000100:00100000:3.0:1790784318.907102:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790784318.907111:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3281:x1877773359525888:12345-0@lo:400: 00000100:00100000:1.0:1790784318.907118:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1877773359525760:12345-0@lo:400: Request processed in 64us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784318.907125:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790784318.907148:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3281:x1877773359525888:12345-0@lo:400: Request processed in 38us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784318.907156:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784318.907160:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790784318.907187:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790784318.907196:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3280:1877773359525504:0@lo:400: 00000100:00100000:1.0:1790784318.907225:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790784318.907268:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790784318.907273:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790784318.907283:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359525632 00000100:00100000:1.0:1790784318.907287:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359525632 00000100:00100000:1.0:1790784318.907309:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790784318.907316:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906a73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1877773359525632:12345-0@lo:400: 00000100:00100000:1.0:1790784318.907355:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906a73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1877773359525632:12345-0@lo:400: Request processed in 39us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784318.907362:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1790784318.907421:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94592d223800 x1877773359525888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1790784318.907427:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94592d220a80 x1877773359525632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790784334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784318.907444:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359525888:0@lo:400: 00000100:00100000:1.0:1790784318.907447:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1877773359525632:0@lo:400: 00010000:00080000:0.0:1790784318.907467:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94592d222680 x1877773359525760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790784334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784318.907477:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359525760:0@lo:400: 00000100:00100000:3.0:1790784318.907631:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359525504 00000100:00100000:3.0:1790784318.907635:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359525504 00000100:00100000:3.0:1790784318.907770:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790784318.907779:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:3280:x1877773359525504:12345-0@lo:400: 00000100:00100000:3.0:1790784318.907829:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:3280:x1877773359525504:12345-0@lo:400: Request processed in 52us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784318.907834:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790784318.907864:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3280:1877773359525504:0@lo:400: 00000100:00100000:1.0:1790784318.908122:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359526016:0@lo:13: 00000100:00100000:1.0:1790784318.908150:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784318.908487:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359526016 00000100:00100000:0.0:1790784318.908494:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359526016 00000100:00100000:0.0:1790784318.908527:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790784318.908533:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906a71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1877773359526016:12345-0@lo:13: 00002000:00000024:0.0:1790784318.908573:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790784318.908628:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906a71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1877773359526016:12345-0@lo:13: Request processed in 95us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784318.908635:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790784318.909916:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9459057c3100 x1877773359526016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784318.909940:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359526016:0@lo:13: 00010000:00010000:3.0:1790784318.971333:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790784319.524728:0:6693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1790784319.998788:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784321.018868:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784322.045065:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784323.069060:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784324.026556:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359526144:0@lo:13: 00000100:00100000:0.0:1790784324.026680:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784324.026892:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359526144 00000100:00100000:2.0:1790784324.026900:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359526144 00000100:00100000:2.0:1790784324.026962:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790784324.026971:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359526144:12345-0@lo:13: 00002000:00000024:2.0:1790784324.026999:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790784324.027041:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359526144:12345-0@lo:13: Request processed in 71us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784324.027049:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1790784324.027341:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790784324.027481:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94593c29dc00 x1877773359526144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784340 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784324.027492:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1790784324.027511:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359526144:0@lo:13: 00000100:00100000:0.0:1790784324.028031:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359526272:0@lo:400: 00000100:00100000:0.0:1790784324.028086:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784324.028122:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790784324.028128:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1877773359526400:0@lo:400: 00000100:00100000:0.0:1790784324.028155:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784324.028186:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359526400 00000100:00100000:0.0:1790784324.028191:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359526400 00000100:00100000:0.0:1790784324.028221:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790784324.028228:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1877773359526400:12345-0@lo:400: 00000100:00100000:0.0:1790784324.028264:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1877773359526400:12345-0@lo:400: Request processed in 36us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784324.028271:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790784324.028297:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359526528:0@lo:400: 00000100:00100000:0.0:1790784324.028320:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784324.028345:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359526528 00000100:00100000:0.0:1790784324.028349:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359526528 00000100:00100000:0.0:1790784324.028412:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790784324.028419:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359526528:12345-0@lo:400: 00000100:00100000:0.0:1790784324.028451:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359526528:12345-0@lo:400: Request processed in 33us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784324.028456:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1790784324.028470:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790784324.028486:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff945906a70380 x1877773359526528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790784340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784324.028497:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359526528:0@lo:400: 00010000:00080000:0.0:1790784324.028519:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff945906a71880 x1877773359526400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790784340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784324.028554:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1877773359526400:0@lo:400: 00000100:00100000:1.0:1790784324.028655:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359526272 00000100:00100000:1.0:1790784324.028665:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359526272 00000100:00100000:1.0:1790784324.028693:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790784324.028700:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:3281:x1877773359526272:12345-0@lo:400: 00000100:00100000:1.0:1790784324.028732:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:3281:x1877773359526272:12345-0@lo:400: Request processed in 33us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784324.028738:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790784324.028860:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359526272:0@lo:400: 00010000:00010000:2.0:1790784324.092252:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784325.114684:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784326.138536:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784327.163849:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784328.186758:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790784328.977529:0:7599:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790784328.978319:0:7599:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1790784328.978474:0:7599:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff94593fa9a800 00000020:01000004:3.0:1790784328.978491:0:7599:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1790784328.978511:0:7599:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1790784328.978524:0:7599:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff94592d4cb380) 00000020:00000080:3.0:1790784328.978597:0:7599:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790784328.991066:0:7599:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1790784328.991353:0:7599:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1790784329.008845:0:7599:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1790784329.013690:0:7599:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790784329.013722:0:7599:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1790784329.013781:0:7599:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790784329.013808:0:7599:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1790784329.014796:0:7599:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1790784329.014807:0:7599:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790784329.014818:0:7599:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2c3a1e2a079d3549 00000020:01000004:2.0:1790784329.014826:0:7599:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1790784329.014845:0:7599:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.132@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790784329.014854:0:7599:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790784329.014859:0:7599:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1790784329.014879:0:7599:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1790784329.014882:0:7599:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.132@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1790784329.031489:0:7599:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.132@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790784329.031535:0:7599:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.132@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1790784329.031539:0:7599:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790784329.031541:0:7599:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790784329.031542:0:7599:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790784329.031544:0:7599:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790784329.031545:0:7599:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790784329.031546:0:7599:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790784329.031548:0:7599:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790784329.031549:0:7599:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790784329.031551:0:7599:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790784329.031552:0:7599:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790784329.031553:0:7599:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790784329.031557:0:7599:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1790784329.031559:0:7599:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790784329.031560:0:7599:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790784329.031567:0:7599:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790784329.031568:0:7599:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790784329.031569:0:7599:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790784329.031570:0:7599:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790784329.031571:0:7599:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790784329.031572:0:7599:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790784329.031572:0:7599:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790784329.031573:0:7599:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790784329.031574:0:7599:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790784329.031600:0:7599:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1790784329.031618:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d223480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359526656:0@lo:253: 00000100:00100000:3.0:1790784329.031937:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784329.031993:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff945903313c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790784329.032080:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359526656 00000100:00100000:1.0:1790784329.032088:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359526656 00000100:00100000:1.0:1790784329.032183:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790784329.032193:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:7599:x1877773359526656:12345-0@lo:253: 20000000:01000000:1.0:1790784329.032221:0:5812:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1790784329.032225:0:5812:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1790784329.032229:0:5812:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1790784329.032233:0:5812:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1790784329.033193:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790784329.033367:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1790784329.033410:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1790784329.033453:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1790784329.033463:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1790784329.033495:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1790784329.033570:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1790784329.033941:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1790784329.033962:0:5812:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.132@tcp 20000000:01000000:1.0:1790784329.033964:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.132@tcp (null) (null) (null) 00000040:00080000:1.0:1790784329.034003:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1790784329.034014:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1790784329.034063:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1790784329.034075:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.132@tcp (null) (null) 00000040:00080000:1.0:1790784329.034121:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1790784329.034133:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1790784329.034166:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1790784329.034236:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1790784329.035331:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1790784329.035356:0:5812:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.132@tcp 20000000:01000000:1.0:1790784329.035358:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.132@tcp (null) (null) (null) 00000040:00080000:1.0:1790784329.035531:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1790784329.035542:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1790784329.035578:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1790784329.035589:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.132@tcp (null) (null) 00000040:00080000:1.0:1790784329.035623:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1790784329.035635:0:5812:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1790784329.035685:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1790784329.035732:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1790784329.035754:0:5812:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1790784329.035756:0:5812:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1790784329.035762:0:5812:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1790784329.035763:0:5812:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1790784329.035765:0:5812:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1790784329.035775:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1790784329.035778:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1790784329.035809:0:5812:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1790784329.035811:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790784329.036513:0:7601:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1790784329.036567:0:7601:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1790784329.036620:0:7601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1790784329.036917:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1790784329.036964:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1790784329.037005:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1790784329.037020:0:5812:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1790784329.037023:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1790784329.037517:0:7602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1790784329.037727:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1790784329.037770:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1790784329.037830:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1790784329.037854:0:5812:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1790784329.037857:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790784329.038279:0:7603:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1790784329.038325:0:7603:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1790784329.038409:0:7603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1790784329.038618:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1790784329.038662:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1790784329.038723:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1790784329.038738:0:5812:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1790784329.038740:0:5812:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1790784329.039304:0:7604:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1790784329.039368:0:7604:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1790784329.039443:0:7604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1790784329.039674:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1790784329.039722:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1790784329.039781:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:1.0:1790784329.039803:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1790784329.039821:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94590955f400/0x2c3a1e2a079d3550 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.039837:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff945901524000/0x2c3a1e2a079d34a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d349a expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.039844:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff945909575400/0x2c3a1e2a079d34cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d34c4 expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.039851:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff945909575e00/0x2c3a1e2a079d34f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d34ee expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.039858:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff945900030000/0x2c3a1e2a079d3511 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d350a expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.039864:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94590955f800/0x2c3a1e2a079d353b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3534 expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.039871:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94590955f400/0x2c3a1e2a079d3550 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.039907:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94590955f800/0x2c3a1e2a079d353b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d3534 expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.039932:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94590955f800/0x2c3a1e2a079d353b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3534 expref: 16 pid: 5812 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784329.039945:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a70000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1877773359526784:0@lo:104: 00000100:00100000:1.0:1790784329.040005:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790784329.040096:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff945900030000/0x2c3a1e2a079d3511 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d350a expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.040104:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff945900030000/0x2c3a1e2a079d3511 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d350a expref: 16 pid: 5812 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784329.040112:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a73480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1877773359526912:0@lo:104: 00010000:00010000:1.0:1790784329.040135:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff945909575e00/0x2c3a1e2a079d34f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d34ee expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.040143:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff945909575e00/0x2c3a1e2a079d34f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d34ee expref: 16 pid: 5812 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784329.040149:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a70e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1877773359527040:0@lo:104: 00010000:00010000:1.0:1790784329.040170:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff945909575400/0x2c3a1e2a079d34cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d34c4 expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.040177:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff945909575400/0x2c3a1e2a079d34cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d34c4 expref: 16 pid: 5811 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784329.040185:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a72300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1877773359527168:0@lo:104: 00010000:00010000:1.0:1790784329.040207:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff945901524000/0x2c3a1e2a079d34a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d349a expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.040226:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff945901524000/0x2c3a1e2a079d34a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d349a expref: 16 pid: 5812 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784329.040236:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a72d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1877773359527296:0@lo:104: 00000100:00100000:1.0:1790784329.040255:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593f4819c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790784329.040453:0:5800:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1790784329.040472:0:5800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784329.040546:0:5800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784329.040603:0:5800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784329.040622:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359526784 00000100:00100000:0.0:1790784329.040629:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359526784 00000100:00100000:0.0:1790784329.040661:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359526912 00000100:00100000:0.0:1790784329.040663:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359526912 00000100:00100000:0.0:1790784329.040674:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359527040 00000100:00100000:0.0:1790784329.040676:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359527040 00000100:00100000:0.0:1790784329.040687:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790784329.040695:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945910a33050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+5:5812:x1877773359526784:12345-0@lo:104: 00010000:00010000:0.0:1790784329.040706:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff945900030c00/0x2c3a1e2a079d3534 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d353b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784329.040769:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790784329.040776:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945910a33050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+5:5812:x1877773359526784:12345-0@lo:104: Request processed in 82us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784329.040783:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790784329.040820:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790784329.040827:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d221880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+4:5812:x1877773359526912:12345-0@lo:104: 00010000:00010000:0.0:1790784329.040835:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff945901525e00/0x2c3a1e2a079d350a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d3511 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784329.040866:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790784329.040870:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d221880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+4:5812:x1877773359526912:12345-0@lo:104: Request processed in 45us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784329.040875:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790784329.040894:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790784329.040900:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d221180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+3:5812:x1877773359527040:12345-0@lo:104: 00010000:00010000:0.0:1790784329.040907:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff945901525800/0x2c3a1e2a079d34ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d34f5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784329.040934:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790784329.040939:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d221180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+3:5812:x1877773359527040:12345-0@lo:104: Request processed in 40us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784329.040943:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1790784329.041007:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790784329.041013:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff945900030c00/0x2c3a1e2a079d3534 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d353b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.041021:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030c00 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:1.0:1790784329.041025:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff945900030c00/0x2c3a1e2a079d3534 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d353b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.041034:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff945900030c00/0x2c3a1e2a079d3534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d353b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790784329.041041:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff945900030c00/0x2c3a1e2a079d3534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d353b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790784329.041047:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790784329.041080:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff945900030c00/0x2c3a1e2a079d3534 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d353b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.041087:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790784329.041107:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff945900030c00/0x2c3a1e2a079d3534 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d353b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.041112:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff945900030c00/0x2c3a1e2a079d3534 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d353b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.041134:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790784329.041137:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff945901525e00/0x2c3a1e2a079d350a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d3511 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.041143:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901525e00 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:1.0:1790784329.041146:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff945901525e00/0x2c3a1e2a079d350a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d3511 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.041152:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff945901525e00/0x2c3a1e2a079d350a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d3511 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790784329.041157:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff945901525e00/0x2c3a1e2a079d350a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d3511 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790784329.041162:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790784329.041174:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff945901525e00/0x2c3a1e2a079d350a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3511 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.041180:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790784329.041193:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff945901525e00/0x2c3a1e2a079d350a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3511 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.041199:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff945901525e00/0x2c3a1e2a079d350a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3511 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.041209:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790784329.041211:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff945901525800/0x2c3a1e2a079d34ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d34f5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.041224:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901525800 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:1.0:1790784329.041227:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff945901525800/0x2c3a1e2a079d34ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d34f5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.041233:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff945901525800/0x2c3a1e2a079d34ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d34f5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790784329.041239:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff945901525800/0x2c3a1e2a079d34ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d34f5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790784329.041243:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790784329.041256:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff945901525800/0x2c3a1e2a079d34ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d34f5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.041261:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790784329.041266:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff945901525800/0x2c3a1e2a079d34ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d34f5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.041272:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff945901525800/0x2c3a1e2a079d34ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d34f5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.041280:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784329.041282:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784329.041284:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790784329.041296:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3280:1877773359527424:0@lo:103: 00000100:00100000:1.0:1790784329.041324:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784329.041368:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359527552:0@lo:103: 00000100:00100000:1.0:1790784329.041412:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784329.041436:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790784329.041442:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359527680:0@lo:103: 00000100:00100000:1.0:1790784329.041462:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784329.041492:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359527424 00000100:00100000:1.0:1790784329.041496:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359527424 00010000:00010000:1.0:1790784329.041525:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94590955f800/0x2c3a1e2a079d353b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3534 expref: 17 pid: 5812 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784329.041539:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359527552 00000100:00100000:1.0:1790784329.041542:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359527552 00010000:00010000:1.0:1790784329.041551:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff945900030000/0x2c3a1e2a079d3511 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d350a expref: 18 pid: 5812 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784329.041561:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359527680 00000100:00100000:1.0:1790784329.041564:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359527680 00010000:00010000:1.0:1790784329.041572:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff945909575e00/0x2c3a1e2a079d34f5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d34ee expref: 19 pid: 5812 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784329.041583:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790784329.041589:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906a71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3280:x1877773359527424:12345-0@lo:103: 00010000:00010000:1.0:1790784329.041598:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784329.041603:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94590955f800/0x2c3a1e2a079d353b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3534 expref: 19 pid: 5812 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.041613:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94590955f800/0x2c3a1e2a079d353b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3534 expref: 19 pid: 5812 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.041627:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790784329.041655:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906a71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3280:x1877773359527424:12345-0@lo:103: Request processed in 66us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784329.041661:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790784329.041681:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790784329.041687:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906a70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:3281:x1877773359527552:12345-0@lo:103: 00010000:00010000:1.0:1790784329.041694:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784329.041698:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff945900030000/0x2c3a1e2a079d3511 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d350a expref: 18 pid: 5812 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.041706:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff945900030000/0x2c3a1e2a079d3511 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d350a expref: 18 pid: 5812 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.041716:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790784329.041742:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906a70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:3281:x1877773359527552:12345-0@lo:103: Request processed in 55us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784329.041747:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790784329.041759:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790784329.041764:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906a71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:3281:x1877773359527680:12345-0@lo:103: 00010000:00010000:1.0:1790784329.041770:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784329.041774:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff945909575e00/0x2c3a1e2a079d34f5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d34ee expref: 17 pid: 5812 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.041781:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff945909575e00/0x2c3a1e2a079d34f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d34ee expref: 17 pid: 5812 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.041791:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790784329.041810:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906a71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:3281:x1877773359527680:12345-0@lo:103: Request processed in 46us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784329.041816:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790784329.041850:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3280:1877773359527424:0@lo:103: 00000100:00100000:1.0:1790784329.041874:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359527680:0@lo:103: 00000100:00100000:1.0:1790784329.041891:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359527552:0@lo:103: 00010000:00010000:1.0:1790784329.041914:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94590955f800/0x2c3a1e2a079d353b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d3534 expref: 16 pid: 5812 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784329.041924:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a70000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1877773359526784:0@lo:104: 00010000:00010000:1.0:1790784329.041933:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945900030000/0x2c3a1e2a079d3511 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d350a expref: 15 pid: 5812 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784329.041941:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a73480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1877773359526912:0@lo:104: 00010000:00010000:1.0:1790784329.041949:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945909575e00/0x2c3a1e2a079d34f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d34ee expref: 14 pid: 5812 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784329.041957:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a70e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1877773359527040:0@lo:104: 00010000:00010000:2.0:1790784329.042079:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784329.042193:0:5800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784329.042262:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359527168 00000100:00100000:0.0:1790784329.042267:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359527168 00000100:00100000:0.0:1790784329.042285:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359527296 00000100:00100000:0.0:1790784329.042287:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359527296 00000100:00100000:0.0:1790784329.042297:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790784329.042303:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d222680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+4:5812:x1877773359527168:12345-0@lo:104: 00010000:00010000:0.0:1790784329.042311:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d34c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d34cb expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784329.042364:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790784329.042368:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d222680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+4:5812:x1877773359527168:12345-0@lo:104: Request processed in 67us (1766us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784329.042396:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790784329.042409:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790784329.042415:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d223800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+3:5812:x1877773359527296:12345-0@lo:104: 00010000:00010000:0.0:1790784329.042423:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d349a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d34a1 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784329.042453:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790784329.042464:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d223800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+3:5812:x1877773359527296:12345-0@lo:104: Request processed in 49us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784329.042470:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1790784329.042529:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790784329.042536:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d34c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d34cb expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.042543:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900031600 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:2.0:1790784329.042547:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d34c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d34cb expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.042555:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d34c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d34cb expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790784329.042562:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d34c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d34cb expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790784329.042567:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790784329.042609:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d34c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d34cb expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.042616:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790784329.042631:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d34c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d34cb expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.042638:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d34c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d34cb expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.042649:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790784329.042658:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d349a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d34a1 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.042663:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901525a00 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:2.0:1790784329.042666:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d349a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d34a1 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.042673:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d349a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d34a1 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790784329.042679:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d349a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d34a1 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790784329.042685:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790784329.042698:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d349a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d34a1 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.042704:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790784329.042709:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d349a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d34a1 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.042716:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d349a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d34a1 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.042729:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784329.042731:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784329.042733:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784329.042744:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359527808:0@lo:103: 00000100:00100000:2.0:1790784329.042771:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784329.042799:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790784329.042804:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359527936:0@lo:103: 00000100:00100000:2.0:1790784329.042831:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784329.042856:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359527808 00000100:00100000:2.0:1790784329.042860:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359527808 00010000:00010000:2.0:1790784329.042876:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff945909575400/0x2c3a1e2a079d34cb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d34c4 expref: 14 pid: 5811 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784329.042893:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359527936 00000100:00100000:2.0:1790784329.042896:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359527936 00010000:00010000:2.0:1790784329.042908:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff945901524000/0x2c3a1e2a079d34a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d349a expref: 15 pid: 5812 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784329.042919:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790784329.042924:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:3279:x1877773359527808:12345-0@lo:103: 00010000:00010000:2.0:1790784329.042932:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784329.042937:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff945909575400/0x2c3a1e2a079d34cb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d34c4 expref: 15 pid: 5811 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.042946:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff945909575400/0x2c3a1e2a079d34cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d34c4 expref: 15 pid: 5811 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.042957:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790784329.042983:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:3279:x1877773359527808:12345-0@lo:103: Request processed in 58us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784329.042989:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790784329.043000:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790784329.043005:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:3279:x1877773359527936:12345-0@lo:103: 00010000:00010000:2.0:1790784329.043012:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784329.043015:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff945901524000/0x2c3a1e2a079d34a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d349a expref: 14 pid: 5812 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.043035:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff945901524000/0x2c3a1e2a079d34a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d349a expref: 14 pid: 5812 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.043046:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94590955f400/0x2c3a1e2a079d3550 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.043054:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94590955f400/0x2c3a1e2a079d3550 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.043067:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94590955f400/0x2c3a1e2a079d3550 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.043074:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94590955f400/0x2c3a1e2a079d3550 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.043081:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94590955f400/0x2c3a1e2a079d3550 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.043087:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94590955f400/0x2c3a1e2a079d3550 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.043092:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955f400 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:2.0:1790784329.043096:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94590955f400/0x2c3a1e2a079d3550 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.043103:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94590955f400/0x2c3a1e2a079d3550 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.043110:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94590955f400/0x2c3a1e2a079d3550 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.043127:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790784329.043148:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:3279:x1877773359527936:12345-0@lo:103: Request processed in 142us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784329.043154:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790784329.043181:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359527936:0@lo:103: 00000100:00100000:2.0:1790784329.043188:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359527808:0@lo:103: 00010000:00010000:2.0:1790784329.043202:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784329.043320:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945909575400/0x2c3a1e2a079d34cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d34c4 expref: 13 pid: 5811 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784329.043330:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a72300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1877773359527168:0@lo:104: 00010000:00010000:1.0:1790784329.043337:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945901524000/0x2c3a1e2a079d34a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d349a expref: 12 pid: 5812 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784329.043345:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a72d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5812:1877773359527296:0@lo:104: 00010000:00010000:1.0:1790784329.043364:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94590955f400/0x2c3a1e2a079d3550 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.043453:0:5812:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94590955f400/0x2c3a1e2a079d3550 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.043461:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94590955f400/0x2c3a1e2a079d3550 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.043475:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94590955f400/0x2c3a1e2a079d3550 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790784329.043487:0:5812:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1790784329.090181:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+11:7599:x1877773359526656:12345-0@lo:253: Request processed in 57981us (58236us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784329.090195:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790784329.090304:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d223480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359526656:0@lo:253: 10000000:01000000:0.0:1790784329.090318:0:7599:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1790784329.090322:0:7599:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790784329.090323:0:7599:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790784329.090325:0:7599:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790784329.090326:0:7599:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1790784329.090328:0:7599:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790784329.090329:0:7599:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790784329.090330:0:7599:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790784329.090332:0:7599:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1790784329.090333:0:7599:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790784329.090334:0:7599:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790784329.090351:0:7599:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94593fa9a800 from lustre-OST0001 10000000:01000000:0.0:1790784329.090405:0:7599:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1790784329.090415:0:7599:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1790784329.090422:0:7599:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9459057499c0 local copy 10000000:01000000:0.0:1790784329.090425:0:7599:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790784329.090456:0:7599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945907102000/0x2c3a1e2a079d3557 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784329.090467:0:7599:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.132@tcp lock: ffff945907102000/0x2c3a1e2a079d3557 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784329.090477:0:7599:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff945907102000/0x2c3a1e2a079d3557 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784329.090492:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359528064:0@lo:101: 00000100:00100000:0.0:1790784329.090533:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784329.090567:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff945903bc5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790784329.090671:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359528064 00000100:00100000:1.0:1790784329.090677:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359528064 00000100:00100000:1.0:1790784329.090714:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790784329.090722:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+11:7599:x1877773359528064:12345-0@lo:101: 00010000:00010000:1.0:1790784329.090733:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784329.090745:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94590955f400/0x2c3a1e2a079d355e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d3557 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.090765:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94590955f400/0x2c3a1e2a079d355e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3557 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.090776:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94590955f400/0x2c3a1e2a079d355e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3557 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.090784:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94590955f400, rc 0) 00000100:00100000:1.0:1790784329.090818:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:7599:x1877773359528064:12345-0@lo:101: Request processed in 96us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784329.090823:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790784329.090966:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359528064:0@lo:101: 00010000:00010000:0.0:1790784329.090990:0:7599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff945907102000/0x2c3a1e2a079d3557 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2c3a1e2a079d355e expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784329.090998:0:7599:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff945907102000/0x2c3a1e2a079d3557 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2c3a1e2a079d355e expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784329.091094:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359528192:0@lo:501: 00000100:00100000:0.0:1790784329.091120:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784329.091143:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff945903bc5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790784329.091201:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359528192 00000100:00100000:3.0:1790784329.091206:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359528192 00000100:00100000:3.0:1790784329.091243:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790784329.091249:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:7599:x1877773359528192:12345-0@lo:501: 00000100:00100000:3.0:1790784329.091463:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:7599:x1877773359528192:12345-0@lo:501: Request processed in 213us (341us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790784329.091469:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790784329.091637:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359528192:0@lo:501: 10000000:01000000:0.0:1790784329.091652:0:7599:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1790784329.091676:0:7599:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.132@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1790784329.091683:0:7599:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945907102000/0x2c3a1e2a079d3557 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2c3a1e2a079d355e expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784329.091690:0:7599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945907102000/0x2c3a1e2a079d3557 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2c3a1e2a079d355e expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784329.091697:0:7599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.132@tcp lock: ffff945907102000/0x2c3a1e2a079d3557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2c3a1e2a079d355e expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784329.091718:0:7599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790784329.091737:0:7599:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94593fa9a800 10000000:01000000:0.0:1790784329.091741:0:7599:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790784329.091746:0:7599:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1790784329.091748:0:7599:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790784329.091752:0:7599:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1790784329.091754:0:7599:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1790784329.091774:0:7599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945907102800/0x2c3a1e2a079d3565 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784329.091781:0:7599:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff945907102800/0x2c3a1e2a079d3565 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784329.091789:0:7599:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff945907102800/0x2c3a1e2a079d3565 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784329.091799:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359528320:0@lo:101: 00000100:00100000:0.0:1790784329.091824:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784329.091854:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff945903bc5600 going to sleep for 11 seconds 00010000:00010000:2.0:1790784329.091910:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790784329.091917:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff945907102000/0x2c3a1e2a079d3557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2c3a1e2a079d355e expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.091925:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945907102000 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:2.0:1790784329.091929:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff945907102000/0x2c3a1e2a079d3557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2c3a1e2a079d355e expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.091937:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff945907102000/0x2c3a1e2a079d3557 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x2c3a1e2a079d355e expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790784329.091945:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff945907102000/0x2c3a1e2a079d3557 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x2c3a1e2a079d355e expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790784329.091950:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790784329.091967:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff945907102000/0x2c3a1e2a079d3557 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2c3a1e2a079d355e expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.091974:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790784329.091995:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff945907102000/0x2c3a1e2a079d3557 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2c3a1e2a079d355e expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.092012:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff945907102000/0x2c3a1e2a079d3557 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2c3a1e2a079d355e expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.092024:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784329.092025:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784329.092027:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784329.092067:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359528448:0@lo:103: 00000100:00100000:0.0:1790784329.092094:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784329.092163:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359528448 00000100:00100000:2.0:1790784329.092168:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359528448 00000100:00100000:2.0:1790784329.092210:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790784329.092217:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:3281:x1877773359528448:12345-0@lo:103: 00010000:00010000:2.0:1790784329.092227:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784329.092239:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94590955f400/0x2c3a1e2a079d355e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2c3a1e2a079d3557 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.092252:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790784329.092280:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+11:3281:x1877773359528448:12345-0@lo:103: Request processed in 64us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784329.092287:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790784329.092340:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359528320 00000100:00100000:3.0:1790784329.092344:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359528320 00000100:00100000:3.0:1790784329.092370:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790784329.092400:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+11:7599:x1877773359528320:12345-0@lo:101: 00010000:00010000:3.0:1790784329.092517:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784329.092529:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945901524600/0x2c3a1e2a079d356c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d3565 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784329.092619:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945901524600/0x2c3a1e2a079d356c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3565 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784329.092629:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945901524600/0x2c3a1e2a079d356c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3565 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784329.092635:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945901524600, rc 0) 00000100:00100000:3.0:1790784329.092757:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:7599:x1877773359528320:12345-0@lo:101: Request processed in 357us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784329.092763:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790784329.092850:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359528448:0@lo:103: 00000100:00100000:2.0:1790784329.093142:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359528320:0@lo:101: 00010000:00010000:2.0:1790784329.093156:0:7599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff945907102800/0x2c3a1e2a079d3565 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d356c expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.093164:0:7599:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff945907102800/0x2c3a1e2a079d3565 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d356c expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784329.093247:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359528576:0@lo:501: 00000100:00100000:2.0:1790784329.093276:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784329.093364:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff945906616780 going to sleep for 11 seconds 00000100:00100000:3.0:1790784329.093615:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359528576 00000100:00100000:3.0:1790784329.093621:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359528576 00000100:00100000:3.0:1790784329.093698:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790784329.093706:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:7599:x1877773359528576:12345-0@lo:501: 00000100:00100000:3.0:1790784329.093924:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:7599:x1877773359528576:12345-0@lo:501: Request processed in 218us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784329.093937:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790784329.093999:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359528576:0@lo:501: 00000100:00100000:2.0:1790784329.094027:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359528704:0@lo:503: 00000100:00100000:2.0:1790784329.094066:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784329.094141:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff945906616780 going to sleep for 11 seconds 00000100:00100000:1.0:1790784329.094204:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359528704 00000100:00100000:1.0:1790784329.094208:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359528704 00000100:00100000:1.0:1790784329.094231:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790784329.094237:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:7599:x1877773359528704:12345-0@lo:503: 00000100:00100000:1.0:1790784329.094412:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:7599:x1877773359528704:12345-0@lo:503: Request processed in 175us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784329.094428:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790784329.094531:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359528704:0@lo:503: 00000040:00080000:2.0:1790784329.094796:0:7599:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790784329.094852:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359528832:0@lo:502: 00000100:00100000:2.0:1790784329.094891:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784329.094932:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff945906616780 going to sleep for 11 seconds 00000100:00100000:1.0:1790784329.095350:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359528832 00000100:00100000:1.0:1790784329.095356:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359528832 00000100:00100000:1.0:1790784329.095412:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790784329.095420:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:7599:x1877773359528832:12345-0@lo:502: 00000100:00100000:1.0:1790784329.095617:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:7599:x1877773359528832:12345-0@lo:502: Request processed in 196us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784329.095624:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790784329.095770:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359528832:0@lo:502: 00000040:00080000:2.0:1790784329.096032:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1790784329.096085:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1790784329.096123:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1790784329.096184:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1790784329.096224:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1790784329.096261:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1790784329.096289:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359528960:0@lo:502: 00000100:00100000:2.0:1790784329.096331:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784329.096365:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff945906616780 going to sleep for 11 seconds 00000100:00100000:1.0:1790784329.096683:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359528960 00000100:00100000:1.0:1790784329.096690:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359528960 00000100:00100000:1.0:1790784329.096718:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790784329.096725:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:7599:x1877773359528960:12345-0@lo:502: 00000100:00100000:1.0:1790784329.096891:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:7599:x1877773359528960:12345-0@lo:502: Request processed in 166us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784329.096897:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790784329.096980:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359528960:0@lo:502: 00000040:00080000:2.0:1790784329.097084:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1790784329.097094:0:7599:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1790784329.097751:0:7605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790784329.097759:0:7605:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1790784329.097765:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790784329.097767:0:7605:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1790784329.097772:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790784329.097794:0:7605:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff94592d5dcd40) 00000020:00000080:1.0:1790784329.097814:0:7605:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1790784329.097821:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790784329.097873:0:7605:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94593fa9a800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1790784329.097881:0:7605:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790784329.097887:0:7605:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2c3a1e2a079d357a 00010000:00010000:1.0:1790784329.101608:0:7605:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1790784329.101957:0:7605:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1790784329.104665:0:7605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1790784329.104931:0:7605:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1790784329.108868:0:7605:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1790784329.109296:0:7605:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1790784329.111178:0:7605:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1790784329.111190:0:7605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790784329.111196:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790784329.111198:0:7605:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1790784329.111202:0:7605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790784329.111205:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790784329.111207:0:7605:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790784329.111210:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790784329.111212:0:7605:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790784329.111256:0:7605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790784329.111259:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790784329.111261:0:7605:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790784329.111264:0:7605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1790784329.114512:0:7599:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1790784329.114618:0:7599:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1790784329.114683:0:7599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945907102800/0x2c3a1e2a079d3565 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d356c expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.114695:0:7599:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff945907102800/0x2c3a1e2a079d3565 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d356c expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790784329.114703:0:7599:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94593fa9a800 from 1 10000000:01000000:1.0:1790784329.114705:0:7599:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790784329.114753:0:7599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff94590955f800/0x2c3a1e2a079d3581 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.114761:0:7599:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff94590955f800/0x2c3a1e2a079d3581 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.114771:0:7599:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff94590955f800/0x2c3a1e2a079d3581 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784329.114793:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359529088:0@lo:101: 00000100:00100000:1.0:1790784329.114874:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784329.114919:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593cfcb180 going to sleep for 11 seconds 00000100:00100000:3.0:1790784329.115920:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359529088 00000100:00100000:3.0:1790784329.115931:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359529088 00000100:00100000:3.0:1790784329.115979:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790784329.115988:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:7599:x1877773359529088:12345-0@lo:101: 00010000:00010000:3.0:1790784329.116002:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784329.116016:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945901524800/0x2c3a1e2a079d3588 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d3581 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784329.116040:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945901524800/0x2c3a1e2a079d3588 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3581 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784329.116050:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945901524800/0x2c3a1e2a079d3588 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3581 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784329.116057:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945901524800, rc 0) 00000100:00100000:3.0:1790784329.116108:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:7599:x1877773359529088:12345-0@lo:101: Request processed in 121us (1234us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784329.116116:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790784329.117525:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359529088:0@lo:101: 00010000:00010000:1.0:1790784329.117557:0:7599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff94590955f800/0x2c3a1e2a079d3581 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3588 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.117580:0:7599:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff94590955f800/0x2c3a1e2a079d3581 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d3588 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784329.117689:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359529216:0@lo:501: 00000100:00100000:1.0:1790784329.117734:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784329.117775:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593cfcb180 going to sleep for 11 seconds 00000100:00100000:3.0:1790784329.117930:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359529216 00000100:00100000:3.0:1790784329.117936:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359529216 00000100:00100000:3.0:1790784329.117977:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790784329.117986:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:7599:x1877773359529216:12345-0@lo:501: 00000100:00100000:3.0:1790784329.118203:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:7599:x1877773359529216:12345-0@lo:501: Request processed in 218us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784329.118210:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790784329.118362:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359529216:0@lo:501: 00000100:00100000:1.0:1790784329.118409:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359529344:0@lo:503: 00000100:00100000:1.0:1790784329.118447:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784329.118470:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359529344 00000100:00100000:1.0:1790784329.118474:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359529344 00000100:00100000:1.0:1790784329.118509:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790784329.118516:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:7599:x1877773359529344:12345-0@lo:503: 00000100:00100000:1.0:1790784329.118823:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:7599:x1877773359529344:12345-0@lo:503: Request processed in 306us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784329.118829:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790784329.118866:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593cfcb180 going to sleep for 11 seconds 00000100:00100000:1.0:1790784329.118879:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359529344:0@lo:503: 00000040:00080000:1.0:1790784329.119126:0:7599:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790784329.119190:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359529472:0@lo:502: 00000100:00100000:1.0:1790784329.119226:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784329.119250:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359529472 00000100:00100000:1.0:1790784329.119254:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359529472 00000100:00100000:1.0:1790784329.119275:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790784329.119282:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:7599:x1877773359529472:12345-0@lo:502: 00000100:00100000:1.0:1790784329.119446:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:7599:x1877773359529472:12345-0@lo:502: Request processed in 164us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784329.119452:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790784329.119487:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459183ee6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790784329.119512:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359529472:0@lo:502: 00000040:00080000:1.0:1790784329.119733:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1790784329.119783:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1790784329.119807:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359529600:0@lo:502: 00000100:00100000:1.0:1790784329.119841:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784329.119864:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359529600 00000100:00100000:1.0:1790784329.119868:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359529600 00000100:00100000:1.0:1790784329.119890:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790784329.119896:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:7599:x1877773359529600:12345-0@lo:502: 00000100:00100000:1.0:1790784329.120003:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:7599:x1877773359529600:12345-0@lo:502: Request processed in 106us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784329.120010:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790784329.120043:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593cfcb180 going to sleep for 11 seconds 00000100:00100000:1.0:1790784329.120055:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359529600:0@lo:502: 00000040:00080000:1.0:1790784329.120126:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1790784329.120138:0:7599:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1790784329.120472:0:7609:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790784329.120481:0:7609:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790784329.120483:0:7609:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790784329.120490:0:7609:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94593fa9a800 00000020:00000080:1.0:1790784329.120493:0:7609:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790784329.120529:0:7609:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790784329.120532:0:7609:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790784329.120539:0:7609:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1790784329.120542:0:7609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1790784329.120572:0:7599:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1790784329.120590:0:7599:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790784329.123081:0:7599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff94590955f800/0x2c3a1e2a079d3581 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3588 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.123096:0:7599:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff94590955f800/0x2c3a1e2a079d3581 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3588 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790784329.123151:0:7599:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790784329.123154:0:7599:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94593fa9a800 10000000:01000000:1.0:1790784329.123157:0:7599:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94593fa9a800 10000000:01000000:1.0:1790784329.123161:0:7599:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790784329.123167:0:7599:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94593fa9a800 from 1 10000000:01000000:1.0:1790784329.123170:0:7599:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790784329.123204:0:7599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff94590955f400/0x2c3a1e2a079d358f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.123214:0:7599:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff94590955f400/0x2c3a1e2a079d358f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.123224:0:7599:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff94590955f400/0x2c3a1e2a079d358f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784329.123244:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359529728:0@lo:101: 00000100:00100000:1.0:1790784329.123308:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784329.123407:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593cfcb180 going to sleep for 11 seconds 00000100:00100000:2.0:1790784329.123689:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359529728 00000100:00100000:2.0:1790784329.123696:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359529728 00000100:00100000:2.0:1790784329.123772:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790784329.123782:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:7599:x1877773359529728:12345-0@lo:101: 00010000:00010000:2.0:1790784329.123817:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784329.123830:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945909574e00/0x2c3a1e2a079d3596 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d358f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.123852:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945909574e00/0x2c3a1e2a079d3596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d358f expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.123862:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945909574e00/0x2c3a1e2a079d3596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d358f expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.123871:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945909574e00, rc 0) 00000100:00100000:2.0:1790784329.123918:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:7599:x1877773359529728:12345-0@lo:101: Request processed in 137us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784329.123925:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790784329.123990:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359529728:0@lo:101: 00010000:00010000:3.0:1790784329.124014:0:7599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff94590955f400/0x2c3a1e2a079d358f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3596 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784329.124022:0:7599:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff94590955f400/0x2c3a1e2a079d358f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d3596 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784329.124114:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d220a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359529856:0@lo:501: 00000100:00100000:3.0:1790784329.124143:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784329.124308:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905135840 going to sleep for 11 seconds 00000100:00100000:1.0:1790784329.124407:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359529856 00000100:00100000:1.0:1790784329.124412:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359529856 00000100:00100000:1.0:1790784329.124435:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790784329.124449:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:7599:x1877773359529856:12345-0@lo:501: 00000100:00100000:1.0:1790784329.124914:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:7599:x1877773359529856:12345-0@lo:501: Request processed in 465us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784329.124922:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790784329.125008:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d220a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359529856:0@lo:501: 00000100:00100000:3.0:1790784329.125036:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d220a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359529984:0@lo:503: 00000100:00100000:3.0:1790784329.125076:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784329.125136:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905135840 going to sleep for 11 seconds 00000100:00100000:0.0:1790784329.125164:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359529984 00000100:00100000:0.0:1790784329.125169:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359529984 00000100:00100000:1.0:1790784329.125214:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790784329.125222:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:7599:x1877773359529984:12345-0@lo:503: 00000100:00100000:1.0:1790784329.125362:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:7599:x1877773359529984:12345-0@lo:503: Request processed in 141us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784329.125369:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790784329.125564:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d220a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359529984:0@lo:503: 00000040:00080000:3.0:1790784329.125955:0:7599:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790784329.126015:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d220a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359530112:0@lo:502: 00000100:00100000:3.0:1790784329.126056:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784329.126088:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905135840 going to sleep for 11 seconds 00000100:00100000:2.0:1790784329.126146:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359530112 00000100:00100000:2.0:1790784329.126151:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359530112 00000100:00100000:2.0:1790784329.126183:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790784329.126191:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:7599:x1877773359530112:12345-0@lo:502: 00000100:00100000:2.0:1790784329.126369:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:7599:x1877773359530112:12345-0@lo:502: Request processed in 178us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784329.126444:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790784329.126638:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d220a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359530112:0@lo:502: 00000040:00080000:3.0:1790784329.126975:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1790784329.127026:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1790784329.127062:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1790784329.127109:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1790784329.127147:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1790784329.127195:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1790784329.127233:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1790784329.127266:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1790784329.127328:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1790784329.127364:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1790784329.127446:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1790784329.127528:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1790784329.127694:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1790784329.127730:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1790784329.127779:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1790784329.127900:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1790784329.127934:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1790784329.127982:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1790784329.128018:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1790784329.128052:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1790784329.128100:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1790784329.128138:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1790784329.128172:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1790784329.128220:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1790784329.128256:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1790784329.128290:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1790784329.128341:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1790784329.128519:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1790784329.128648:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1790784329.128699:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1790784329.128737:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1790784329.128790:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1790784329.128977:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1790784329.129036:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1790784329.129079:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1790784329.129126:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1790784329.129163:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1790784329.129209:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d220a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359530240:0@lo:502: 00000100:00100000:3.0:1790784329.129282:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784329.132963:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905135840 going to sleep for 11 seconds 00000100:00100000:0.0:1790784329.133356:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359530240 00000100:00100000:0.0:1790784329.133372:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359530240 00000100:00100000:0.0:1790784329.133430:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790784329.133439:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:7599:x1877773359530240:12345-0@lo:502: 00000100:00100000:0.0:1790784329.133723:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:7599:x1877773359530240:12345-0@lo:502: Request processed in 285us (4441us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784329.133731:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790784329.134325:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d220a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359530240:0@lo:502: 00000040:00080000:0.0:1790784329.134605:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1790784329.134620:0:7599:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1790784329.135327:0:7610:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1790784329.135342:0:7610:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff945905748000) 00000020:00000080:0.0:1790784329.135361:0:7610:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1790784329.135953:0:7610:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94593fa9a800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790784329.135958:0:7610:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94593fa9a800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790784329.135961:0:7610:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94593fa9a800 3 00010000:00080000:0.0:1790784329.135988:0:7610:0:(ldlm_lib.c:102:import_set_conn()) imp ffff945935df6800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.132@tcp at head 00010000:00010000:0.0:1790784329.138058:0:7610:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1790784329.138337:0:7610:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1790784329.138402:0:7610:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790784329.138416:0:7610:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2c3a1e2a079d35a4 00000100:00080000:0.0:1790784329.138425:0:7610:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790784329.138436:0:7610:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff945935df6800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:0.0:1790784329.138469:0:7610:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9459057c2d80 x1877773359530368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790784329.138509:0:7610:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000040:00080000:0.0:1790784329.138747:0:7610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1790784329.138996:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1877773359530496:0@lo:400: 00000100:00100000:1.0:1790784329.139055:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784329.139103:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359530624:0@lo:400: 00000100:00100000:1.0:1790784329.139126:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784329.139144:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790784329.139150:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359530752:0@lo:400: 00000100:00100000:1.0:1790784329.139173:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784329.139203:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359530496 00000100:00100000:1.0:1790784329.139209:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359530496 00000100:00100000:1.0:1790784329.139243:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359530624 00000100:00100000:1.0:1790784329.139246:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359530624 00000100:00100000:1.0:1790784329.139270:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790784329.139278:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1877773359530496:12345-0@lo:400: 00000100:00100000:1.0:1790784329.139325:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1877773359530496:12345-0@lo:400: Request processed in 47us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784329.139332:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790784329.139345:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790784329.139365:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906a70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359530624:12345-0@lo:400: 00000100:00100000:1.0:1790784329.139416:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906a70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359530624:12345-0@lo:400: Request processed in 52us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784329.139422:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790784329.139443:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359530752 00000100:00100000:1.0:1790784329.139447:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359530752 00000100:00100000:1.0:1790784329.139472:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790784329.139478:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906a71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359530752:12345-0@lo:400: 00000100:00100000:1.0:1790784329.139524:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906a71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359530752:12345-0@lo:400: Request processed in 46us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784329.139530:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1790784329.139548:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790784329.139553:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790784329.139577:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff945906a73480 x1877773359530752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790784329.139589:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359530752:0@lo:400: 00010000:00080000:1.0:1790784329.139600:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff945906a70e00 x1877773359530624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790784345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790784329.139608:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359530624:0@lo:400: 00010000:00080000:1.0:1790784329.139633:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff945906a72300 x1877773359530496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790784345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790784329.139642:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1877773359530496:0@lo:400: 00000100:00100000:2.0:1790784329.139902:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3278:1877773359530368:0@lo:38: 00000100:00100000:2.0:1790784329.139937:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1790784329.139983:0:7599:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1790784329.140007:0:7599:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790784329.140022:0:7599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff94590955f400/0x2c3a1e2a079d358f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3596 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.140045:0:7599:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff94590955f400/0x2c3a1e2a079d358f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3596 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790784329.140090:0:7599:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790784329.140092:0:7599:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790784329.140093:0:7599:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790784329.140095:0:7599:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790784329.140096:0:7599:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790784329.140097:0:7599:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790784329.140098:0:7599:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790784329.140100:0:7599:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790784329.140101:0:7599:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790784329.140103:0:7599:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790784329.140104:0:7599:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790784329.140108:0:7599:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1790784329.140110:0:7599:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790784329.140112:0:7599:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790784329.140113:0:7599:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790784329.140114:0:7599:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790784329.140115:0:7599:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790784329.140116:0:7599:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790784329.140117:0:7599:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790784329.140118:0:7599:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790784329.140120:0:7599:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790784329.140121:0:7599:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790784329.140122:0:7599:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790784329.140138:0:7599:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790784329.140148:0:7599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359530880:0@lo:253: 00000100:00100000:2.0:1790784329.140181:0:7599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784329.140196:0:7599:0:(client.c:2716:ptlrpc_set_wait()) set ffff945906616600 going to sleep for 11 seconds 00000100:00100000:0.0:1790784329.140287:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359530880 00000100:00100000:0.0:1790784329.140293:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359530880 00000100:00100000:0.0:1790784329.140397:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790784329.140405:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:7599:x1877773359530880:12345-0@lo:253: 20000000:01000000:0.0:1790784329.140426:0:5811:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1790784329.140438:0:5811:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1790784329.140930:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359530368 00000100:00100000:1.0:1790784329.140935:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359530368 00000100:00100000:1.0:1790784329.140959:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790784329.140964:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3278:x1877773359530368:12345-0@lo:38: 00010000:00080000:1.0:1790784329.140990:0:5819:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 163 last 0 00000020:00000080:1.0:1790784329.141019:0:5819:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2c3a1e2a079d35ab 00000004:00100000:1.0:1790784329.141031:0:5819:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790784329.141057:0:5819:0:(import.c:65:import_set_state_nolock()) ffff94592d5d2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790784329.141107:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1877773359530368:12345-0@lo:38: Request processed in 141us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784329.141113:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1790784329.141153:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9459057c2d80 x1877773359530368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790784339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790784329.141163:0:3278:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790784329.141169:0:3278:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1790784329.141177:0:3278:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790784329.141181:0:3278:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790784329.141183:0:3278:0:(import.c:65:import_set_state_nolock()) ffff945935df6800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790784329.141189:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3278:1877773359530368:0@lo:38: 00000100:00100000:0.0:1790784329.141328:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c1f80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7611:1877773359531008:0@lo:901: 00000100:00100000:0.0:1790784329.141367:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784329.141413:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff945903bc5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790784329.141490:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359531008 00000100:00100000:3.0:1790784329.141494:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359531008 00000100:00100000:3.0:1790784329.141546:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790784329.141554:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7611:x1877773359531008:12345-0@lo:901: 00000100:00100000:3.0:1790784329.141945:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7611:x1877773359531008:12345-0@lo:901: Request processed in 390us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784329.141952:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1790784329.144639:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790784329.144686:0:7611:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9459057c1f80 x1877773359531008/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1790784345 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784329.144701:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c1f80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7611:1877773359531008:0@lo:901: 00000100:00100000:2.0:1790784329.149188:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359531136:0@lo:13: 00000100:00100000:2.0:1790784329.149263:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784329.149312:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359531136 00000100:00100000:2.0:1790784329.149320:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359531136 00000100:00100000:2.0:1790784329.149401:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790784329.149411:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359531136:12345-0@lo:13: 00002000:00000024:2.0:1790784329.149440:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790784329.149483:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359531136:12345-0@lo:13: Request processed in 74us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784329.149489:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1790784329.149554:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94593c29d880 x1877773359531136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784345 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790784329.149572:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359531136:0@lo:13: 20000000:01000000:1.0:1790784329.170463:0:5811:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790784329.170484:0:5811:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1790784329.170546:0:5834:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790784329.170551:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790784329.170573:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff945907102c00/0x2c3a1e2a079d35b2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784329.170591:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff945900031800/0x2c3a1e2a079d3503 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d34fc expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784329.170600:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff945907102c00/0x2c3a1e2a079d35b2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784329.170637:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff945900031800/0x2c3a1e2a079d3503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d34fc expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784329.170652:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff945900031800/0x2c3a1e2a079d3503 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d34fc expref: 14 pid: 5812 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784329.170664:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c1f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5834:1877773359531264:0@lo:104: 00000100:00100000:0.0:1790784329.170736:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784329.170778:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910384cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790784329.171204:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359531264 00000100:00100000:1.0:1790784329.171212:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359531264 00000100:00100000:1.0:1790784329.171259:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790784329.171267:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+3:5834:x1877773359531264:12345-0@lo:104: 00010000:00010000:1.0:1790784329.171280:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d34fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d3503 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784329.171329:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790784329.171335:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+3:5834:x1877773359531264:12345-0@lo:104: Request processed in 69us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784329.171352:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790784329.171679:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c1f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5834:1877773359531264:0@lo:104: 00010000:00010000:0.0:1790784329.171698:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff945907102c00/0x2c3a1e2a079d35b2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.172612:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790784329.172622:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d34fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d3503 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.172630:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955ea00 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:2.0:1790784329.172635:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d34fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d3503 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.172644:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d34fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d3503 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790784329.172652:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d34fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d3503 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790784329.172658:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790784329.172700:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d34fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3503 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.172706:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790784329.172723:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d34fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3503 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.172739:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d34fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3503 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.172758:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784329.172759:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784329.172761:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784329.172776:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359531392:0@lo:103: 00000100:00100000:2.0:1790784329.172825:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784329.172878:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359531392 00000100:00100000:2.0:1790784329.172883:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359531392 00010000:00010000:2.0:1790784329.172906:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff945900031800/0x2c3a1e2a079d3503 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d34fc expref: 15 pid: 5812 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784329.172931:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790784329.172939:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905194c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:3282:x1877773359531392:12345-0@lo:103: 00010000:00010000:2.0:1790784329.172950:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784329.172955:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff945900031800/0x2c3a1e2a079d3503 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d34fc expref: 15 pid: 5812 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.172965:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff945900031800/0x2c3a1e2a079d3503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d34fc expref: 15 pid: 5812 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.172994:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945900031800/0x2c3a1e2a079d3503 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d34fc expref: 15 pid: 5812 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.173008:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff945907102c00/0x2c3a1e2a079d35b2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.173026:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945907102c00/0x2c3a1e2a079d35b2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790784329.173040:0:5803:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002816997s 00010000:00010000:2.0:1790784329.173045:0:5803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff945907102c00/0x2c3a1e2a079d35b2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.173051:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff945907102c00/0x2c3a1e2a079d35b2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.173057:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff945907102c00/0x2c3a1e2a079d35b2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.173063:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff945907102c00/0x2c3a1e2a079d35b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.173068:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945907102c00 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:2.0:1790784329.173072:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff945907102c00/0x2c3a1e2a079d35b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.173080:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff945907102c00/0x2c3a1e2a079d35b2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.173094:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff945907102c00/0x2c3a1e2a079d35b2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.173104:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790784329.173136:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905194c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:3282:x1877773359531392:12345-0@lo:103: Request processed in 197us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784329.173143:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1790784329.173266:0:5834:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff945907102c00/0x2c3a1e2a079d35b2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.173274:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff945907102c00/0x2c3a1e2a079d35b2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784329.173280:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945907102c00/0x2c3a1e2a079d35b2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784329.173308:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359531392:0@lo:103: 00000100:00100000:1.0:1790784329.178263:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:7599:x1877773359530880:12345-0@lo:253: Request processed in 37851us (38074us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784329.178277:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790784329.178409:0:7599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:7599:1877773359530880:0@lo:253: 10000000:01000000:3.0:1790784329.178423:0:7599:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1790784329.178426:0:7599:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790784329.178428:0:7599:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790784329.178429:0:7599:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790784329.178431:0:7599:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790784329.178432:0:7599:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790784329.178433:0:7599:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790784329.178435:0:7599:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790784329.178436:0:7599:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790784329.178437:0:7599:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790784329.178438:0:7599:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790784329.178439:0:7599:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790784329.178451:0:7599:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1790784329.183229:0:7599:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1790784329.183461:0:7599:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1790784329.184185:0:7599:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1790784329.184352:0:7599:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1790784329.184775:0:7599:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1790784329.185022:0:7599:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1790784329.186331:0:7599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1790784329.212435:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1790784329.381785:0:7599:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1790784329.381792:0:7599:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1790784329.381891:0:7599:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790784329.381941:0:7599:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.132@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790784329.381956:0:7599:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1790784329.381981:0:7599:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1790784330.234773:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784331.259525:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784332.282695:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784333.307594:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790784334.270860:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359531520:0@lo:13: 00000100:00100000:1.0:1790784334.271002:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784334.271181:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3280:1877773359531648:0@lo:400: 00000100:00100000:1.0:1790784334.271213:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1877773359532032:0@lo:400: 00000100:00100000:3.0:1790784334.271215:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784334.271240:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784334.271264:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1877773359531776:0@lo:400: 00000100:00100000:3.0:1790784334.271266:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359531648 00000100:00100000:3.0:1790784334.271279:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359531648 00000100:00100000:1.0:1790784334.271285:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784334.271300:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790784334.271305:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359531904:0@lo:400: 00000100:00100000:1.0:1790784334.271324:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784334.271454:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790784334.271464:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:3280:x1877773359531648:12345-0@lo:400: 00000100:00100000:1.0:1790784334.271499:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359532032 00000100:00100000:1.0:1790784334.271503:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359532032 00000100:00100000:3.0:1790784334.271519:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:3280:x1877773359531648:12345-0@lo:400: Request processed in 57us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784334.271526:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790784334.271571:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3280:1877773359531648:0@lo:400: 00000100:00100000:0.0:1790784334.271856:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359531520 00000100:00100000:0.0:1790784334.271860:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359531520 00000100:00100000:1.0:1790784334.271861:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359531776 00000100:00100000:1.0:1790784334.271865:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359531776 00000100:00100000:0.0:1790784334.271888:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790784334.271896:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906a72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359531520:12345-0@lo:13: 00002000:00000024:0.0:1790784334.271920:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790784334.271945:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359531904 00000100:00100000:1.0:1790784334.271949:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359531904 00000100:00100000:0.0:1790784334.271960:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906a72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359531520:12345-0@lo:13: Request processed in 65us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784334.271966:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790784334.271967:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790784334.271972:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906a71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1877773359532032:12345-0@lo:400: 00000100:00100000:1.0:1790784334.272003:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906a71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1877773359532032:12345-0@lo:400: Request processed in 30us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784334.272008:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790784334.272028:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790784334.272033:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906a70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1877773359531776:12345-0@lo:400: 00000100:00100000:1.0:1790784334.272076:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906a70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1877773359531776:12345-0@lo:400: Request processed in 43us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784334.272082:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790784334.272093:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790784334.272099:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906a71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1877773359531904:12345-0@lo:400: 00000100:00100000:1.0:1790784334.272254:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906a71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1877773359531904:12345-0@lo:400: Request processed in 154us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784334.272261:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1790784334.272284:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790784334.272288:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790784334.272307:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff945906a70380 x1877773359532032/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790784350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790784334.272318:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1877773359532032:0@lo:400: 00010000:00080000:1.0:1790784334.272329:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593c29d880 x1877773359531520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1790784334.272631:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff945906a73800 x1877773359531904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790784350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784334.272642:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359531904:0@lo:400: 00010000:00080000:0.0:1790784334.272652:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff945906a73480 x1877773359531776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790784350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784334.272660:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1877773359531776:0@lo:400: 00000100:00100000:1.0:1790784334.273181:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359531520:0@lo:13: 00010000:00010000:2.0:1790784334.334579:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790784335.351211:0:7954:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg632-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790784335.355585:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784336.387292:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784337.403218:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784338.427017:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790784339.386727:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790784339.386734:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9459050db000 from 30 10000000:01000000:3.0:1790784339.386739:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790784339.386784:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d35b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784339.386795:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d35b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784339.386806:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d35b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784339.386836:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d220380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359532160:0@lo:101: 00000100:00100000:3.0:1790784339.387026:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784339.387069:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592d92b180 going to sleep for 11 seconds 00000100:00100000:1.0:1790784339.387205:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359532160 00000100:00100000:1.0:1790784339.387213:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359532160 00000100:00100000:1.0:1790784339.387261:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790784339.387270:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:5815:x1877773359532160:12345-0@lo:101: 00010000:00010000:1.0:1790784339.387282:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784339.387293:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94590955ec00/0x2c3a1e2a079d35c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d35b9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784339.387327:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94590955ec00/0x2c3a1e2a079d35c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d35b9 expref: 14 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784339.387337:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94590955ec00/0x2c3a1e2a079d35c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d35b9 expref: 14 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784339.387346:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94590955ec00, rc 0) 00000100:00100000:1.0:1790784339.387411:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:5815:x1877773359532160:12345-0@lo:101: Request processed in 141us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784339.387417:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790784339.387566:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1877773359532288:0@lo:400: 00000100:00100000:1.0:1790784339.387594:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784339.387616:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790784339.387621:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3280:1877773359532672:0@lo:400: 00000100:00100000:1.0:1790784339.387657:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784339.387819:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359532416:0@lo:400: 00000100:00100000:1.0:1790784339.387845:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784339.387864:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790784339.387870:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359532544:0@lo:400: 00000100:00100000:1.0:1790784339.387893:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784339.387926:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359532288 00000100:00100000:1.0:1790784339.387930:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359532288 00000100:00100000:1.0:1790784339.387949:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359532672 00000100:00100000:1.0:1790784339.387951:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359532672 00000100:00100000:1.0:1790784339.387968:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359532416 00000100:00100000:1.0:1790784339.387970:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359532416 00000100:00100000:1.0:1790784339.387981:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790784339.387994:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906a70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1877773359532288:12345-0@lo:400: 00000100:00100000:1.0:1790784339.388032:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906a70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1877773359532288:12345-0@lo:400: Request processed in 38us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784339.388038:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790784339.388051:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790784339.388057:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906bead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1877773359532672:12345-0@lo:400: 00000100:00100000:1.0:1790784339.388082:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906bead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1877773359532672:12345-0@lo:400: Request processed in 26us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784339.388087:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790784339.388097:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790784339.388102:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1877773359532416:12345-0@lo:400: 00000100:00100000:1.0:1790784339.388128:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1877773359532416:12345-0@lo:400: Request processed in 25us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784339.388134:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790784339.388155:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359532544 00000100:00100000:1.0:1790784339.388159:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359532544 00000100:00100000:1.0:1790784339.388185:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790784339.388192:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906beb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359532544:12345-0@lo:400: 00000100:00100000:1.0:1790784339.388219:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906beb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359532544:12345-0@lo:400: Request processed in 28us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784339.388224:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1790784339.388238:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790784339.388242:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790784339.388983:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359532800:0@lo:13: 00000100:00100000:0.0:1790784339.389242:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1790784339.389295:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff945906a73800 x1877773359532672/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790784355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784339.389309:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3280:1877773359532672:0@lo:400: 00010000:00080000:0.0:1790784339.389320:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff945906a70380 x1877773359532288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790784355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784339.389328:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1877773359532288:0@lo:400: 00000100:00100000:3.0:1790784339.389599:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359532800 00000100:00100000:3.0:1790784339.389605:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359532800 00000100:00100000:3.0:1790784339.389641:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790784339.389649:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359532800:12345-0@lo:13: 00002000:00000024:3.0:1790784339.389695:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790784339.389739:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359532800:12345-0@lo:13: Request processed in 91us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784339.389745:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790784339.397975:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d220380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359532160:0@lo:101: 00010000:00010000:1.0:1790784339.398008:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d35b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d35c0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784339.398045:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d35b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d35c0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784339.398122:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906be8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359532928:0@lo:501: 00000100:00100000:1.0:1790784339.398184:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784339.398227:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff94590ad13c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790784339.398252:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359532928 00000100:00100000:1.0:1790784339.398258:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359532928 00010000:00080000:0.0:1790784339.398283:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94592d223100 x1877773359532800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790784339.398294:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790784339.398302:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:5815:x1877773359532928:12345-0@lo:501: 00000100:00100000:0.0:1790784339.398303:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359532800:0@lo:13: 00010000:00080000:0.0:1790784339.398353:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff945906a73480 x1877773359532544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784339.398361:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359532544:0@lo:400: 00010000:00080000:0.0:1790784339.398371:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff945906a72d80 x1877773359532416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790784355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784339.398397:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359532416:0@lo:400: 00000100:00100000:0.0:1790784339.398680:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:5815:x1877773359532928:12345-0@lo:501: Request processed in 378us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784339.398688:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790784339.398725:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906be8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359532928:0@lo:501: 00000100:00100000:0.0:1790784339.398754:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359533056:0@lo:503: 00000100:00100000:0.0:1790784339.398792:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784339.398812:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff945906616600 going to sleep for 11 seconds 00000100:00100000:0.0:1790784339.398830:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359533056 00000100:00100000:0.0:1790784339.398834:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359533056 00000100:00100000:0.0:1790784339.399058:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790784339.399068:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:5815:x1877773359533056:12345-0@lo:503: 00000100:00100000:0.0:1790784339.399416:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:5815:x1877773359533056:12345-0@lo:503: Request processed in 349us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784339.399424:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790784339.399477:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359533056:0@lo:503: 00000100:00100000:0.0:1790784339.399660:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8107:1877773359533184:0@lo:502: 00000100:00100000:0.0:1790784339.399695:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784339.399716:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359533184 00000100:00100000:0.0:1790784339.399720:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359533184 00000100:00100000:0.0:1790784339.399741:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790784339.399748:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:8107:x1877773359533184:12345-0@lo:502: 00000100:00100000:1.0:1790784339.400433:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff945906616c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790784339.401314:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:8107:x1877773359533184:12345-0@lo:502: Request processed in 1563us (1615us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784339.401326:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1790784339.401542:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8107:1877773359533184:0@lo:502: 00000100:00100000:1.0:1790784339.401614:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906beaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8107:1877773359533312:0@lo:502: 00000100:00100000:1.0:1790784339.401660:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784339.401687:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359533312 00000100:00100000:1.0:1790784339.401692:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359533312 00000100:00100000:1.0:1790784339.401727:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790784339.401735:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:8107:x1877773359533312:12345-0@lo:502: 00000100:00100000:0.0:1790784339.402483:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff94590ad13c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790784339.402714:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:8107:x1877773359533312:12345-0@lo:502: Request processed in 976us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784339.402722:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790784339.402812:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906beaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8107:1877773359533312:0@lo:502: 00000040:00080000:0.0:1790784339.403361:0:8107:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1790784339.403574:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1790784339.403603:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790784339.403613:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d35b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d35c0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784339.403623:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d35b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d35c0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790784339.403633:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1790784339.403635:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1790784339.403638:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1790784339.403671:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d35c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784339.403680:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d35c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784339.403689:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d35c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784339.403706:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906be8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359533440:0@lo:101: 00000100:00100000:1.0:1790784339.403748:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784339.403782:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459051add80 going to sleep for 11 seconds 00000100:00100000:0.0:1790784339.404484:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359533440 00000100:00100000:0.0:1790784339.404492:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359533440 00000100:00100000:0.0:1790784339.404531:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790784339.404541:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:5815:x1877773359533440:12345-0@lo:101: 00010000:00010000:0.0:1790784339.404554:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784339.404567:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945907103600/0x2c3a1e2a079d35ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d35c7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784339.404589:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945907103600/0x2c3a1e2a079d35ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d35c7 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784339.404613:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945907103600/0x2c3a1e2a079d35ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d35c7 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784339.404621:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945907103600, rc 0) 00000100:00100000:0.0:1790784339.404675:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:5815:x1877773359533440:12345-0@lo:101: Request processed in 136us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784339.404681:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790784339.404809:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906be8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359533440:0@lo:101: 00010000:00010000:2.0:1790784339.404823:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d35c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d35ce expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784339.404832:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d35c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d35ce expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784339.404888:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359533568:0@lo:501: 00000100:00100000:2.0:1790784339.404918:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784339.404949:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff945907d8a540 going to sleep for 11 seconds 00000100:00100000:0.0:1790784339.404954:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359533568 00000100:00100000:0.0:1790784339.404958:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359533568 00000100:00100000:0.0:1790784339.406143:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790784339.406156:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:5815:x1877773359533568:12345-0@lo:501: 00000100:00100000:0.0:1790784339.406434:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:5815:x1877773359533568:12345-0@lo:501: Request processed in 281us (1514us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784339.406441:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1790784339.406921:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359533568:0@lo:501: 00000100:00100000:2.0:1790784339.406964:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359533696:0@lo:503: 00000100:00100000:2.0:1790784339.407071:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784339.407106:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff945907d8a540 going to sleep for 11 seconds 00000100:00100000:0.0:1790784339.407151:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359533696 00000100:00100000:0.0:1790784339.407158:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359533696 00000100:00100000:0.0:1790784339.407234:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790784339.407243:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:5815:x1877773359533696:12345-0@lo:503: 00000100:00100000:0.0:1790784339.408966:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:5815:x1877773359533696:12345-0@lo:503: Request processed in 1717us (1888us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784339.408977:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1790784339.409272:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359533696:0@lo:503: 00000100:00100000:1.0:1790784339.410143:0:8108:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906bebb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8108:1877773359533824:0@lo:502: 00000100:00100000:1.0:1790784339.410207:0:8108:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784339.410281:0:8108:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459051ad000 going to sleep for 11 seconds 00000100:00100000:0.0:1790784339.410318:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359533824 00000100:00100000:0.0:1790784339.410324:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359533824 00000100:00100000:1.0:1790784339.410809:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790784339.410819:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:8108:x1877773359533824:12345-0@lo:502: 00000100:00100000:1.0:1790784339.411152:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:8108:x1877773359533824:12345-0@lo:502: Request processed in 334us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784339.411167:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790784339.411248:0:8108:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906bebb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8108:1877773359533824:0@lo:502: 00000020:01000000:2.0:1790784339.411285:0:8108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790784339.411293:0:8108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784339.411295:0:8108:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790784339.411299:0:8108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790784339.411301:0:8108:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1790784339.411324:0:8108:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8108:1877773359533952:0@lo:502: 00000100:00100000:2.0:1790784339.411389:0:8108:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784339.411649:0:8108:0:(client.c:2716:ptlrpc_set_wait()) set ffff945907d8a540 going to sleep for 11 seconds 00000100:00100000:0.0:1790784339.412752:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359533952 00000100:00100000:0.0:1790784339.412763:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359533952 00000100:00100000:0.0:1790784339.412803:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1790784339.412810:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:8108:x1877773359533952:12345-0@lo:502: 00000100:00100000:0.0:1790784339.413171:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:8108:x1877773359533952:12345-0@lo:502: Request processed in 360us (1795us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784339.413179:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790784339.413278:0:8108:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8108:1877773359533952:0@lo:502: 00000020:01000000:2.0:1790784339.413318:0:8108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790784339.413324:0:8108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784339.413327:0:8108:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790784339.413331:0:8108:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1790784339.413610:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1790784339.413631:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1790784339.413639:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d35c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d35ce expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784339.413651:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d35c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d35ce expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790784339.413661:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790784339.413664:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff945905fd5000 from 30 10000000:01000000:0.0:1790784339.413667:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790784339.413694:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945907103800/0x2c3a1e2a079d35d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784339.413702:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff945907103800/0x2c3a1e2a079d35d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784339.413712:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff945907103800/0x2c3a1e2a079d35d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784339.413728:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359534080:0@lo:101: 00000100:00100000:0.0:1790784339.413760:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784339.413796:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459066163c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790784339.413915:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359534080 00000100:00100000:2.0:1790784339.413920:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359534080 00000100:00100000:2.0:1790784339.413988:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790784339.414005:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903694c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:5815:x1877773359534080:12345-0@lo:101: 00010000:00010000:2.0:1790784339.414015:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784339.414026:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945909575800/0x2c3a1e2a079d35dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d35d5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784339.414047:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945909575800/0x2c3a1e2a079d35dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d35d5 expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784339.414057:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945909575800/0x2c3a1e2a079d35dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d35d5 expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784339.414065:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945909575800, rc 0) 00000100:00100000:2.0:1790784339.414103:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903694c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:5815:x1877773359534080:12345-0@lo:101: Request processed in 108us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784339.414109:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790784339.414257:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359534080:0@lo:101: 00010000:00010000:0.0:1790784339.414269:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff945907103800/0x2c3a1e2a079d35d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d35dc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784339.414289:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff945907103800/0x2c3a1e2a079d35d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d35dc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784339.414332:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359534208:0@lo:501: 00000100:00100000:0.0:1790784339.417134:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784339.417183:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459066163c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790784339.417215:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359534208 00000100:00100000:0.0:1790784339.417221:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359534208 00000100:00100000:0.0:1790784339.417258:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790784339.417267:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:5815:x1877773359534208:12345-0@lo:501: 00000100:00100000:0.0:1790784339.418217:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:5815:x1877773359534208:12345-0@lo:501: Request processed in 947us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784339.418229:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790784339.418281:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359534208:0@lo:501: 00000100:00100000:0.0:1790784339.418324:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359534336:0@lo:503: 00000100:00100000:0.0:1790784339.418513:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784339.418587:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459066163c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790784339.418730:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359534336 00000100:00100000:1.0:1790784339.418736:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359534336 00000100:00100000:1.0:1790784339.418775:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790784339.418783:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:5815:x1877773359534336:12345-0@lo:503: 00000100:00100000:1.0:1790784339.418942:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:5815:x1877773359534336:12345-0@lo:503: Request processed in 159us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784339.418949:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790784339.419168:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359534336:0@lo:503: 00000100:00100000:0.0:1790784339.419618:0:8110:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8110:1877773359534464:0@lo:502: 00000100:00100000:0.0:1790784339.419656:0:8110:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784339.419688:0:8110:0:(client.c:2716:ptlrpc_set_wait()) set ffff945906616180 going to sleep for 11 seconds 00000100:00100000:1.0:1790784339.419735:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359534464 00000100:00100000:1.0:1790784339.419740:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359534464 00000100:00100000:1.0:1790784339.419771:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790784339.419779:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:8110:x1877773359534464:12345-0@lo:502: 00000100:00100000:1.0:1790784339.420110:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:8110:x1877773359534464:12345-0@lo:502: Request processed in 331us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784339.420118:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790784339.420190:0:8110:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8110:1877773359534464:0@lo:502: 00000100:00100000:0.0:1790784339.420235:0:8110:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8110:1877773359534592:0@lo:502: 00000100:00100000:0.0:1790784339.420274:0:8110:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784339.420297:0:8110:0:(client.c:2716:ptlrpc_set_wait()) set ffff945906616180 going to sleep for 11 seconds 00000100:00100000:1.0:1790784339.420513:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359534592 00000100:00100000:1.0:1790784339.420517:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359534592 00000100:00100000:1.0:1790784339.420540:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790784339.420546:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:8110:x1877773359534592:12345-0@lo:502: 00000100:00100000:1.0:1790784339.420667:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:8110:x1877773359534592:12345-0@lo:502: Request processed in 120us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784339.420673:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790784339.420756:0:8110:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8110:1877773359534592:0@lo:502: 00000040:00080000:0.0:1790784339.420778:0:8110:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1790784339.420984:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1790784339.421938:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790784339.421950:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945907103800/0x2c3a1e2a079d35d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d35dc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784339.421975:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff945907103800/0x2c3a1e2a079d35d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d35dc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790784339.421984:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790784339.421986:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff945905fd5000 from 5 10000000:01000000:1.0:1790784339.421989:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790784339.422084:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff94590955f600/0x2c3a1e2a079d35e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784339.422093:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff94590955f600/0x2c3a1e2a079d35e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784339.422102:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff94590955f600/0x2c3a1e2a079d35e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784339.422119:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906be8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359534720:0@lo:101: 00000100:00100000:1.0:1790784339.422161:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784339.422201:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459051ad3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790784339.422264:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359534720 00000100:00100000:0.0:1790784339.422270:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359534720 00000100:00100000:0.0:1790784339.422311:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790784339.422319:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:5815:x1877773359534720:12345-0@lo:101: 00010000:00010000:0.0:1790784339.422328:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784339.422350:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945907102400/0x2c3a1e2a079d35ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d35e3 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784339.422371:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945907102400/0x2c3a1e2a079d35ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d35e3 expref: 17 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784339.422401:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945907102400/0x2c3a1e2a079d35ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d35e3 expref: 17 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784339.422409:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945907102400, rc 0) 00000100:00100000:0.0:1790784339.422455:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:5815:x1877773359534720:12345-0@lo:101: Request processed in 127us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784339.422462:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790784339.422501:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906be8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359534720:0@lo:101: 00010000:00010000:0.0:1790784339.422512:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff94590955f600/0x2c3a1e2a079d35e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d35ea expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784339.422521:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff94590955f600/0x2c3a1e2a079d35e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d35ea expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784339.422575:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359534848:0@lo:256: 00000100:00100000:0.0:1790784339.422605:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784339.422622:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff945906616300 going to sleep for 11 seconds 00000100:00100000:0.0:1790784339.422633:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359534848 00000100:00100000:0.0:1790784339.422636:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359534848 00000100:00100000:0.0:1790784339.422652:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790784339.422657:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:5815:x1877773359534848:12345-0@lo:256: 20000000:01000000:0.0:1790784339.422669:0:5812:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790784339.422683:0:5812:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790784339.422686:0:5812:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1790784339.422756:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:5815:x1877773359534848:12345-0@lo:256: Request processed in 98us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784339.422763:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790784339.422789:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359534848:0@lo:256: 10000000:01000000:0.0:1790784339.422827:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790784339.422833:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff94590955f600/0x2c3a1e2a079d35e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d35ea expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784339.422974:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff94590955f600/0x2c3a1e2a079d35e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d35ea expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790784339.422982:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1790784339.422984:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1790784339.422986:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1790784339.423060:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945907102e00/0x2c3a1e2a079d35f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784339.423076:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff945907102e00/0x2c3a1e2a079d35f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784339.423085:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff945907102e00/0x2c3a1e2a079d35f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784339.423097:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359534976:0@lo:101: 00000100:00100000:0.0:1790784339.423121:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784339.423135:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff945906616300 going to sleep for 11 seconds 00000100:00100000:0.0:1790784339.423148:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359534976 00000100:00100000:0.0:1790784339.423152:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359534976 00000100:00100000:0.0:1790784339.423169:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790784339.423175:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903696c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:5815:x1877773359534976:12345-0@lo:101: 00010000:00010000:0.0:1790784339.423182:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784339.423189:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945907102000/0x2c3a1e2a079d35f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d35f1 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784339.423203:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945907102000/0x2c3a1e2a079d35f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d35f1 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784339.423211:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945907102000/0x2c3a1e2a079d35f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d35f1 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784339.423217:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945907102000, rc 0) 00000100:00100000:0.0:1790784339.423244:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903696c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:5815:x1877773359534976:12345-0@lo:101: Request processed in 69us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784339.423249:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790784339.423275:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359534976:0@lo:101: 00010000:00010000:0.0:1790784339.423291:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff945907102e00/0x2c3a1e2a079d35f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d35f8 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784339.423298:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff945907102e00/0x2c3a1e2a079d35f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d35f8 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784339.423536:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359535104:0@lo:501: 00000100:00100000:1.0:1790784339.423929:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784339.424060:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff945906616300 going to sleep for 11 seconds 00000100:00100000:0.0:1790784339.424099:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359535104 00000100:00100000:0.0:1790784339.424104:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359535104 00000100:00100000:0.0:1790784339.424228:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790784339.424235:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903694850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:5815:x1877773359535104:12345-0@lo:501: 00000100:00100000:0.0:1790784339.427918:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903694850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:5815:x1877773359535104:12345-0@lo:501: Request processed in 3602us (3907us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784339.427931:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790784339.428106:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359535104:0@lo:501: 00000100:00100000:1.0:1790784339.428153:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906be9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359535232:0@lo:503: 00000100:00100000:1.0:1790784339.428196:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784339.428236:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459051ada80 going to sleep for 11 seconds 00000100:00100000:0.0:1790784339.428287:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359535232 00000100:00100000:0.0:1790784339.428293:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359535232 00000100:00100000:0.0:1790784339.428493:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790784339.428505:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:5815:x1877773359535232:12345-0@lo:503: 00000100:00100000:0.0:1790784339.428792:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:5815:x1877773359535232:12345-0@lo:503: Request processed in 289us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784339.428979:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790784339.429080:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906be9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359535232:0@lo:503: 00000100:00100000:2.0:1790784339.429797:0:8111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8111:1877773359535360:0@lo:502: 00000100:00100000:2.0:1790784339.429908:0:8111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784339.429966:0:8111:0:(client.c:2716:ptlrpc_set_wait()) set ffff945906bf2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790784339.430052:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359535360 00000100:00100000:0.0:1790784339.430057:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359535360 00000100:00100000:0.0:1790784339.430129:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790784339.430137:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:8111:x1877773359535360:12345-0@lo:502: 00000100:00100000:0.0:1790784339.430586:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:8111:x1877773359535360:12345-0@lo:502: Request processed in 448us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784339.430594:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790784339.430702:0:8111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8111:1877773359535360:0@lo:502: 00000020:01000000:2.0:1790784339.430728:0:8111:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790784339.430734:0:8111:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1790784339.430740:0:8111:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784339.430742:0:8111:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1790784339.430746:0:8111:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790784339.430750:0:8111:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.132@tcp to nid 0x20000c0a8ce84 (192.168.206.132@tcp) 00000020:01000000:2.0:1790784339.430771:0:8111:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790784339.430773:0:8111:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790784339.430788:0:8111:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff94593c4a4d40) 00000020:00000080:2.0:1790784339.430806:0:8111:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1790784339.430810:0:8111:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790784339.430946:0:8111:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1790784339.430951:0:8111:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1790784339.430957:0:8111:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2c3a1e2a079d3606 00010000:00080000:2.0:1790784339.430983:0:8111:0:(ldlm_lib.c:102:import_set_conn()) imp ffff945935eff800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.132@tcp at head 00010000:00010000:2.0:1790784339.431246:0:8111:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1790784339.431701:0:8111:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1790784339.431712:0:8111:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790784339.434252:0:8111:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790784339.434898:0:8111:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790784339.434950:0:8111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1790784339.435133:0:8111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1790784339.438615:0:8112:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790784339.438622:0:8112:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1790784339.445883:0:8111:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790784339.445898:0:8111:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790784339.445946:0:8111:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1790784339.445968:0:8111:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2c3a1e2a079d360d 00000100:00080000:3.0:1790784339.445979:0:8111:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790784339.445990:0:8111:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff945935eff800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:3.0:1790784339.446023:0:8111:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94592d220e00 x1877773359535488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790784339.446049:0:8111:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1790784339.446103:0:8111:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790784339.446107:0:8111:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790784339.446109:0:8111:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1790784339.446112:0:8111:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790784339.446115:0:8111:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790784339.446117:0:8111:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790784339.446119:0:8111:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790784339.446121:0:8111:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1790784339.446165:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d220e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1877773359535488:0@lo:8: 00000100:00100000:0.0:1790784339.446229:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784339.446296:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359535488 00000100:00100000:0.0:1790784339.446303:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359535488 00000100:00100000:0.0:1790784339.446346:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790784339.446354:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3278:x1877773359535488:12345-0@lo:8: 00010000:00080000:0.0:1790784339.446410:0:6669:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:0.0:1790784339.446435:0:6669:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2c3a1e2a079d3614 00002000:00100000:0.0:1790784339.446458:0:6669:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff945935df6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1790784339.446463:0:6669:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1790784339.446466:0:6669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1790784339.446580:0:6669:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790784339.446718:0:6669:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790784339.446740:0:6669:0:(import.c:65:import_set_state_nolock()) ffff945935df2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790784339.446787:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3278:x1877773359535488:12345-0@lo:8: Request processed in 432us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784339.446794:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790784339.446800:0:8111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d223100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8111:1877773359535616:0@lo:502: 00010000:00080000:0.0:1790784339.446831:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94592d220e00 x1877773359535488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790784349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784339.446840:0:8111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784339.446853:0:3278:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790784339.446860:0:3278:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00100000:3.0:1790784339.446862:0:8111:0:(client.c:2716:ptlrpc_set_wait()) set ffff945903313840 going to sleep for 11 seconds 00000100:00080000:0.0:1790784339.446867:0:3278:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790784339.446871:0:3278:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1790784339.468329:0:3278:0:(import.c:65:import_set_state_nolock()) ffff945935eff800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790784339.468368:0:3278:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790784339.468396:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d220e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1877773359535488:0@lo:8: 00010000:00010000:0.0:1790784339.468529:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784339.468544:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359535616 00000100:00100000:0.0:1790784339.468552:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359535616 00000100:00100000:0.0:1790784339.468604:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790784339.468616:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:8111:x1877773359535616:12345-0@lo:502: 00000004:00080000:3.0:1790784339.468949:0:8112:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1790784339.469037:0:8112:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 173618661284ns, next at 0ns, rc = 0 00000100:00100000:0.0:1790784339.469178:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:8111:x1877773359535616:12345-0@lo:502: Request processed in 563us (22336us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784339.469187:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1790784339.469317:0:8111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d223100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8111:1877773359535616:0@lo:502: 00000020:01000000:3.0:1790784339.469353:0:8111:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790784339.469360:0:8111:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790784339.469362:0:8111:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790784339.469366:0:8111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1790784339.471258:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1790784339.471292:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790784339.471303:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945907102e00/0x2c3a1e2a079d35f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d35f8 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784339.471315:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff945907102e00/0x2c3a1e2a079d35f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d35f8 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790784339.471325:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1790784339.471327:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9459057499c0 from 1 10000000:01000000:0.0:1790784339.471330:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790784339.471391:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945907102c00/0x2c3a1e2a079d361b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784339.471400:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff945907102c00/0x2c3a1e2a079d361b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784339.471411:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff945907102c00/0x2c3a1e2a079d361b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784339.471439:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359535744:0@lo:101: 00000100:00100000:0.0:1790784339.471508:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784339.471543:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459050a9240 going to sleep for 11 seconds 00000100:00100000:0.0:1790784339.471564:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359535744 00000100:00100000:0.0:1790784339.471570:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359535744 00000100:00100000:0.0:1790784339.471607:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1790784339.471616:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:5815:x1877773359535744:12345-0@lo:101: 00010000:00010000:0.0:1790784339.471627:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784339.471639:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945907102200/0x2c3a1e2a079d3622 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d361b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784339.471660:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945907102200/0x2c3a1e2a079d3622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d361b expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784339.471668:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945907102200/0x2c3a1e2a079d3622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d361b expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784339.471675:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945907102200, rc 0) 00000100:00100000:0.0:1790784339.471710:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:5815:x1877773359535744:12345-0@lo:101: Request processed in 94us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784339.471716:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1790784339.471757:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359535744:0@lo:101: 00010000:00010000:0.0:1790784339.471769:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff945907102c00/0x2c3a1e2a079d361b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3622 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784339.471777:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff945907102c00/0x2c3a1e2a079d361b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d3622 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784339.471833:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359535872:0@lo:501: 00000100:00100000:0.0:1790784339.474510:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784339.474551:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459050a9240 going to sleep for 11 seconds 00000100:00100000:0.0:1790784339.474573:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359535872 00000100:00100000:0.0:1790784339.474580:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359535872 00000100:00100000:0.0:1790784339.474622:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790784339.474631:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:5815:x1877773359535872:12345-0@lo:501: 00000100:00100000:0.0:1790784339.474823:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:5815:x1877773359535872:12345-0@lo:501: Request processed in 192us (315us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790784339.474831:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790784339.474889:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359535872:0@lo:501: 10000000:01000000:0.0:1790784339.474922:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790784339.474931:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945907102c00/0x2c3a1e2a079d361b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3622 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784339.474940:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff945907102c00/0x2c3a1e2a079d361b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3622 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790784339.556552:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1790784339.559767:0:8113:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1790784339.559814:0:8113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d220380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8113:1877773359536128:0@lo:7: 00000100:00100000:3.0:1790784339.559894:0:8113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784339.559943:0:8113:0:(client.c:2716:ptlrpc_set_wait()) set ffff945903313900 going to sleep for 11 seconds 00000100:00100000:3.0:1790784339.559973:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359536128 00000100:00100000:1.0:1790784339.560115:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790784339.560129:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359536000:0@lo:13: 00000100:00100000:1.0:1790784339.560164:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784339.560263:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359536128 00000100:00100000:3.0:1790784339.560327:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790784339.560335:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8113:x1877773359536128:12345-0@lo:7: 00000100:00080000:1.0:1790784339.560570:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790784339.566872:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359536000 00000100:00100000:2.0:1790784339.566886:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359536000 00000100:00100000:2.0:1790784339.567094:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790784339.567106:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906beb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1877773359536000:12345-0@lo:13: 00002000:00000024:2.0:1790784339.567140:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1790784339.567222:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906beb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1877773359536000:12345-0@lo:13: Request processed in 119us (7057us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784339.567229:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00002000:00080000:3.0:1790784339.572714:0:6668:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1790784339.572721:0:6668:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1790784339.572823:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8113:x1877773359536128:12345-0@lo:7: Request processed in 12486us (12926us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784339.572833:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1790784339.573323:0:8113:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94592d220380 x1877773359536128/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790784355 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784339.573339:0:8113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d220380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8113:1877773359536128:0@lo:7: 00000004:00080000:0.0:1790784339.573352:0:8113:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1790784339.573414:0:8113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8113:1877773359536256:0@lo:5: 00000100:00100000:0.0:1790784339.573463:0:8113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784339.573528:0:8113:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459050a9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790784339.573638:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359536256 00000100:00100000:1.0:1790784339.573645:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359536256 00000100:00100000:1.0:1790784339.573692:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790784339.573702:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8113:x1877773359536256:12345-0@lo:5: 00002000:00080000:1.0:1790784339.573726:0:6670:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1790784339.573729:0:6670:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1790784339.574008:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8113:x1877773359536256:12345-0@lo:5: Request processed in 307us (544us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1790784339.574015:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1790784339.574255:0:8113:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9459057c3480 x1877773359536256/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790784355 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784339.574268:0:8113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8113:1877773359536256:0@lo:5: 00000004:00080000:0.0:1790784339.574276:0:8113:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00010000:00080000:2.0:1790784339.574411:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94592d223100 x1877773359536000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790784339.574427:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359536000:0@lo:13: 00000001:00100000:1.0:1790784340.028571:0:7614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1790784340.028939:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00010000:00010000:3.0:1790784340.475365:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784341.499181:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784342.123737:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784342.125735:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344833920 00000100:00100000:1.0:1790784342.125749:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344833920 00000100:00100000:1.0:1790784342.125873:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 110 00000100:00100000:1.0:1790784342.125882:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2348:x1877773344833920:12345-192.168.206.32@tcp:250: 00010000:00080000:1.0:1790784342.125908:0:5811:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 0ca9b063-fa51-4809-8e8c-f4ded37a88b1@192.168.206.32@tcp t0 exp 0000000000000000 cur 176 last 0 00000020:00000080:1.0:1790784342.125939:0:5811:0:(genops.c:1384:class_connect()) connect: client 0ca9b063-fa51-4809-8e8c-f4ded37a88b1, cookie 0x2c3a1e2a079d3629 00000100:00080000:1.0:1790784342.126073:0:5811:0:(import.c:65:import_set_state_nolock()) ffff94592d5d6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790784342.126234:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+5:2348:x1877773344833920:12345-192.168.206.32@tcp:250: Request processed in 350us (2565us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784342.126242:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 110 00000100:00100000:1.0:1790784342.143739:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784342.144513:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344833792 00000100:00100000:0.0:1790784342.144524:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344833792 00000100:00100000:0.0:1790784342.144602:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 111 00000100:00100000:0.0:1790784342.144612:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+5:5579:x1877773344833792:12345-192.168.206.32@tcp:101: 00010000:00010000:0.0:1790784342.144629:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784342.144647:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945907103200/0x2c3a1e2a079d3630 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x394e0d8838134e8c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784342.144673:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945907103200/0x2c3a1e2a079d3630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134e8c expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784342.144688:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945907103200/0x2c3a1e2a079d3630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134e8c expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784342.144696:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945907103200, rc 0) 00000100:00100000:0.0:1790784342.144754:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+6:5579:x1877773344833792:12345-192.168.206.32@tcp:101: Request processed in 144us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784342.144762:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 111 00000100:00100000:2.0:1790784342.152027:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784342.152136:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344834048 00000100:00100000:1.0:1790784342.152148:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344834048 00000100:00100000:1.0:1790784342.152203:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 112 00000100:00100000:1.0:1790784342.152213:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+6:5579:x1877773344834048:12345-192.168.206.32@tcp:501: 00000100:00100000:1.0:1790784342.153075:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+6:5579:x1877773344834048:12345-192.168.206.32@tcp:501: Request processed in 324us (518us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790784342.153096:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 112 00000100:00100000:3.0:1790784342.156873:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784342.157981:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344834176 00000100:00100000:2.0:1790784342.158004:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344834176 00000100:00100000:2.0:1790784342.158071:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 113 00000100:00100000:2.0:1790784342.158082:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+6:5579:x1877773344834176:12345-192.168.206.32@tcp:101: 00010000:00010000:2.0:1790784342.158098:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784342.158127:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945909574400/0x2c3a1e2a079d3637 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x394e0d8838134e93 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784342.158157:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945909574400/0x2c3a1e2a079d3637 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134e93 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784342.158169:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945909574400/0x2c3a1e2a079d3637 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134e93 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784342.158177:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945909574400, rc 0) 00000100:00100000:2.0:1790784342.158255:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+7:5579:x1877773344834176:12345-192.168.206.32@tcp:101: Request processed in 175us (1392us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784342.158263:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 113 00000100:00100000:2.0:1790784342.164141:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784342.164443:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344834304 00000100:00100000:1.0:1790784342.164452:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344834304 00000100:00100000:1.0:1790784342.164506:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 114 00000100:00100000:1.0:1790784342.164516:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+7:5579:x1877773344834304:12345-192.168.206.32@tcp:501: 00000100:00100000:1.0:1790784342.165600:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+8:5579:x1877773344834304:12345-192.168.206.32@tcp:501: Request processed in 1079us (1461us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784342.165611:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 114 00000100:00100000:3.0:1790784342.168410:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784342.168635:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344834432 00000100:00100000:0.0:1790784342.168644:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344834432 00000100:00100000:0.0:1790784342.168709:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 115 00000100:00100000:0.0:1790784342.168719:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+8:5579:x1877773344834432:12345-192.168.206.32@tcp:503: 00000100:00100000:0.0:1790784342.169013:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+8:5579:x1877773344834432:12345-192.168.206.32@tcp:503: Request processed in 295us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784342.169021:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 115 00000100:00100000:3.0:1790784342.181769:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784342.184232:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344834560 00000100:00100000:1.0:1790784342.184245:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344834560 00000100:00100000:1.0:1790784342.184322:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 116 00000100:00100000:1.0:1790784342.184332:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+8:5597:x1877773344834560:12345-192.168.206.32@tcp:502: 00000100:00100000:1.0:1790784342.185010:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+8:5597:x1877773344834560:12345-192.168.206.32@tcp:502: Request processed in 678us (3248us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784342.185019:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 116 00000100:00100000:1.0:1790784342.214805:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784342.215008:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344834688 00000100:00100000:2.0:1790784342.215018:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344834688 00000100:00100000:2.0:1790784342.215076:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 117 00000100:00100000:2.0:1790784342.215086:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+8:5597:x1877773344834688:12345-192.168.206.32@tcp:502: 00000100:00100000:2.0:1790784342.216861:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+8:5597:x1877773344834688:12345-192.168.206.32@tcp:502: Request processed in 1768us (2056us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784342.216875:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 117 00000100:00100000:3.0:1790784342.229850:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784342.230157:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344834816 00000100:00100000:0.0:1790784342.230166:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344834816 00000100:00100000:0.0:1790784342.231549:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 118 00000100:00100000:0.0:1790784342.231663:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+8:5579:x1877773344834816:12345-192.168.206.32@tcp:101: 00010000:00010000:0.0:1790784342.231681:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784342.231756:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945907103400/0x2c3a1e2a079d363e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x394e0d8838134ebd expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784342.231785:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945907103400/0x2c3a1e2a079d363e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134ebd expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784342.231796:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945907103400/0x2c3a1e2a079d363e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134ebd expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784342.231806:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945907103400, rc 0) 00000100:00100000:0.0:1790784342.231872:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+9:5579:x1877773344834816:12345-192.168.206.32@tcp:101: Request processed in 218us (2030us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784342.231880:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 118 00000100:00100000:3.0:1790784342.238756:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784342.238857:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344834944 00000100:00100000:1.0:1790784342.238867:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344834944 00000100:00100000:1.0:1790784342.238935:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 119 00000100:00100000:1.0:1790784342.238946:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+9:5579:x1877773344834944:12345-192.168.206.32@tcp:256: 20000000:01000000:1.0:1790784342.238970:0:5811:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1790784342.238995:0:5811:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1790784342.238999:0:5811:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1790784342.239001:0:5811:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1790784342.239003:0:5811:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1790784342.249088:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+9:5579:x1877773344834944:12345-192.168.206.32@tcp:256: Request processed in 10133us (10329us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784342.249103:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 119 00000100:00100000:3.0:1790784342.255758:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784342.255895:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344835072 00000100:00100000:0.0:1790784342.255908:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344835072 00000100:00100000:0.0:1790784342.255971:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 120 00000100:00100000:0.0:1790784342.255982:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+9:5579:x1877773344835072:12345-192.168.206.32@tcp:101: 00010000:00010000:0.0:1790784342.256003:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784342.256025:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945907103c00/0x2c3a1e2a079d3645 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x394e0d8838134ec4 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784342.256070:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945907103c00/0x2c3a1e2a079d3645 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134ec4 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784342.256083:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945907103c00/0x2c3a1e2a079d3645 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134ec4 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784342.256094:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945907103c00, rc 0) 00000100:00100000:0.0:1790784342.256169:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:5579:x1877773344835072:12345-192.168.206.32@tcp:101: Request processed in 190us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784342.256177:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 120 00000100:00100000:0.0:1790784342.267104:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784342.267218:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344835200 00000100:00100000:1.0:1790784342.267240:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344835200 00000100:00100000:1.0:1790784342.267306:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 121 00000100:00100000:1.0:1790784342.267318:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905f9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:5579:x1877773344835200:12345-192.168.206.32@tcp:501: 00000100:00100000:1.0:1790784342.267640:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905f9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:5579:x1877773344835200:12345-192.168.206.32@tcp:501: Request processed in 324us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784342.267648:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 121 00000100:00100000:1.0:1790784342.276327:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784342.276555:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344835328 00000100:00100000:0.0:1790784342.276564:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344835328 00000100:00100000:0.0:1790784342.276617:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 122 00000100:00100000:0.0:1790784342.276627:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905f9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:5579:x1877773344835328:12345-192.168.206.32@tcp:503: 00000100:00100000:0.0:1790784342.278205:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905f9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:5579:x1877773344835328:12345-192.168.206.32@tcp:503: Request processed in 1573us (1881us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784342.278217:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 122 00000100:00100000:0.0:1790784342.287800:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784342.288013:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344835456 00000100:00100000:2.0:1790784342.288022:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344835456 00000100:00100000:2.0:1790784342.288075:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 123 00000100:00100000:2.0:1790784342.288084:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:5602:x1877773344835456:12345-192.168.206.32@tcp:502: 00000100:00100000:2.0:1790784342.289673:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:5602:x1877773344835456:12345-192.168.206.32@tcp:502: Request processed in 1584us (1877us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784342.289685:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 123 00000100:00100000:2.0:1790784342.293600:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784342.298427:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344835584 00000100:00100000:0.0:1790784342.298451:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344835584 00000100:00100000:0.0:1790784342.298578:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 124 00000100:00100000:0.0:1790784342.298588:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590564b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:5602:x1877773344835584:12345-192.168.206.32@tcp:502: 00000100:00100000:0.0:1790784342.299630:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590564b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:5602:x1877773344835584:12345-192.168.206.32@tcp:502: Request processed in 1040us (6034us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784342.299652:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 124 00000100:00100000:1.0:1790784342.313847:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784342.315732:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344835712 00000100:00100000:2.0:1790784342.315744:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344835712 00000100:00100000:2.0:1790784342.315802:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 4 00000100:00100000:2.0:1790784342.315810:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906be9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2348:x1877773344835712:12345-192.168.206.32@tcp:38: 00010000:00080000:2.0:1790784342.315837:0:5820:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from b0f9e8c2-ddb0-4027-babe-0b166585860c@192.168.206.32@tcp t0 exp 0000000000000000 cur 176 last 0 00000020:00000080:2.0:1790784342.315885:0:5820:0:(genops.c:1384:class_connect()) connect: client b0f9e8c2-ddb0-4027-babe-0b166585860c, cookie 0x2c3a1e2a079d364c 00000004:00100000:2.0:1790784342.316222:0:5820:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1790784342.316242:0:5820:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1790784342.365156:0:5820:0:(import.c:65:import_set_state_nolock()) ffff94592d5d0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790784342.365270:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906be9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2348:x1877773344835712:12345-192.168.206.32@tcp:38: Request processed in 49458us (51431us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784342.365280:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 4 00010000:00010000:3.0:1790784342.522943:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784343.378294:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784343.378355:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784343.381009:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344835968 00000100:00100000:2.0:1790784343.381028:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344835968 00000100:00100000:2.0:1790784343.381141:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344835840 00000100:00100000:2.0:1790784343.381145:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344835840 00000100:00100000:2.0:1790784343.381178:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 5 00000100:00100000:2.0:1790784343.381191:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:5579:x1877773344835968:12345-192.168.206.32@tcp:41: 00000004:00000024:2.0:1790784343.381246:0:5819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1790784343.381340:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:5579:x1877773344835968:12345-192.168.206.32@tcp:41: Request processed in 152us (3062us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784343.381347:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 5 00000100:00100000:2.0:1790784343.381368:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 6 00000100:00100000:2.0:1790784343.381411:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:0:x1877773344835840:12345-192.168.206.32@tcp:41: 00000004:00000024:2.0:1790784343.381436:0:5819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1790784343.381457:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:0:x1877773344835840:12345-192.168.206.32@tcp:41: Request processed in 82us (3102us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784343.381463:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 6 00000100:00080000:3.0:1790784343.382412:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790784343.395477:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784343.395593:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344836096 00000100:00100000:1.0:1790784343.395605:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344836096 00000100:00100000:1.0:1790784343.395664:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 7 00000100:00100000:1.0:1790784343.395674:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:5579:x1877773344836096:12345-192.168.206.32@tcp:40: 00000100:00100000:1.0:1790784343.395777:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:5579:x1877773344836096:12345-192.168.206.32@tcp:40: Request processed in 105us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784343.395784:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 7 00000100:00100000:2.0:1790784343.401485:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784343.401524:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784343.401566:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784343.401718:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344836480 00000100:00100000:0.0:1790784343.401728:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344836480 00000100:00100000:0.0:1790784343.401791:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 0 00000100:00100000:0.0:1790784343.401801:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:5579:x1877773344836480:12345-192.168.206.32@tcp:33: 00000100:00100000:3.0:1790784343.402110:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344836224 00000100:00100000:3.0:1790784343.402115:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344836224 00000100:00100000:3.0:1790784343.402148:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 7 00000100:00100000:3.0:1790784343.402153:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1877773344836224:12345-192.168.206.32@tcp:8: 00010000:00080000:3.0:1790784343.402185:0:6668:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from b0f9e8c2-ddb0-4027-babe-0b166585860c@192.168.206.32@tcp t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:3.0:1790784343.402216:0:6668:0:(genops.c:1384:class_connect()) connect: client b0f9e8c2-ddb0-4027-babe-0b166585860c, cookie 0x2c3a1e2a079d3653 00002000:00100000:3.0:1790784343.402228:0:6668:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b0f9e8c2-ddb0-4027-babe-0b166585860c/ffff945907c62000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790784343.402250:0:6668:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790784343.402624:0:6668:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790784343.402652:0:6668:0:(import.c:65:import_set_state_nolock()) ffff945907c61000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790784343.402721:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2348:x1877773344836224:12345-192.168.206.32@tcp:8: Request processed in 566us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784343.402729:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 7 00000100:00100000:1.0:1790784343.404868:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344836608 00000100:00100000:1.0:1790784343.404881:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344836608 00000100:00100000:1.0:1790784343.404929:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 125 00000100:00100000:1.0:1790784343.404952:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:2352:x1877773344836608:12345-192.168.206.32@tcp:400: 00000100:00100000:1.0:1790784343.405019:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:2352:x1877773344836608:12345-192.168.206.32@tcp:400: Request processed in 69us (3452us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784343.405026:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 125 00000100:00100000:1.0:1790784343.411786:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784343.412099:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344836352 00000100:00100000:0.0:1790784343.412109:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344836352 00000100:00100000:0.0:1790784343.412172:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 8 00000100:00100000:0.0:1790784343.412181:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906be8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1877773344836352:12345-192.168.206.32@tcp:8: 00010000:00080000:0.0:1790784343.412215:0:6669:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from b0f9e8c2-ddb0-4027-babe-0b166585860c@192.168.206.32@tcp t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:0.0:1790784343.412246:0:6669:0:(genops.c:1384:class_connect()) connect: client b0f9e8c2-ddb0-4027-babe-0b166585860c, cookie 0x2c3a1e2a079d365a 00002000:00100000:0.0:1790784343.412257:0:6669:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b0f9e8c2-ddb0-4027-babe-0b166585860c/ffff945935df5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790784343.412277:0:6669:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790784343.412667:0:6669:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790784343.412698:0:6669:0:(import.c:65:import_set_state_nolock()) ffff945935df0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790784343.412762:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906be8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2348:x1877773344836352:12345-192.168.206.32@tcp:8: Request processed in 580us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784343.412770:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 8 00000004:00080000:1.0:1790784343.446712:0:5821:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 44848us 00000004:00200000:0.0:1790784343.494158:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1790784343.494279:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:5579:x1877773344836480:12345-192.168.206.32@tcp:33: Request processed in 92474us (92749us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784343.494290:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 0 00010000:00010000:0.0:1790784343.548163:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790784343.801331:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784343.801753:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344836736 00000100:00100000:2.0:1790784343.801763:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344836736 00000100:00100000:2.0:1790784343.801825:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 8 00000100:00100000:2.0:1790784343.801835:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906be9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:5620:x1877773344836736:12345-192.168.206.32@tcp:101: 00010000:00010000:2.0:1790784343.801855:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784343.804696:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945909574c00/0x2c3a1e2a079d3661 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838134eee expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784343.804773:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945909575e00/0x2c3a1e2a079d3668 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784343.804787:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945909575e00/0x2c3a1e2a079d3668 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784343.804803:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945909575e00/0x2c3a1e2a079d3668 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784343.804837:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790784343.804840:0:5818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790784343.804855:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945909575e00/0x2c3a1e2a079d3668 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784343.804883:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945909574c00/0x2c3a1e2a079d3661 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134eee expref: 8 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784343.804902:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945909575e00/0x2c3a1e2a079d3668 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134eee expref: 7 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784343.804910:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2200) 00010000:00010000:2.0:1790784343.804912:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790784343.804916:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945909575e00, rc 0) 00000100:00100000:2.0:1790784343.804988:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906be9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:5620:x1877773344836736:12345-192.168.206.32@tcp:101: Request processed in 3154us (3663us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784343.804995:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 8 00000100:00100000:0.0:1790784344.506826:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3280:1877773359536640:0@lo:400: 00000100:00100000:0.0:1790784344.506899:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784344.506961:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790784344.506968:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1877773359536512:0@lo:400: 00000100:00100000:3.0:1790784344.507176:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359536640 00000100:00100000:3.0:1790784344.507183:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359536640 00000100:00100000:3.0:1790784344.507234:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790784344.507244:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906a73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1877773359536640:12345-0@lo:400: 00000100:00100000:3.0:1790784344.507295:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906a73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1877773359536640:12345-0@lo:400: Request processed in 53us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784344.507302:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1790784344.507322:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790784344.507411:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359536768:0@lo:400: 00000100:00100000:1.0:1790784344.507453:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784344.507487:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790784344.507493:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359536384:0@lo:400: 00000100:00100000:1.0:1790784344.507520:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784344.507541:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1877773359536896:0@lo:400: 00000100:00100000:1.0:1790784344.507561:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784344.507583:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790784344.507591:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359537152:0@lo:13: 00000100:00100000:1.0:1790784344.507614:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784344.507639:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359537152 00000100:00100000:1.0:1790784344.507642:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359537152 00000100:00100000:1.0:1790784344.507674:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790784344.507681:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906be8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359537152:12345-0@lo:13: 00002000:00000024:1.0:1790784344.507695:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790784344.507729:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906be8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359537152:12345-0@lo:13: Request processed in 48us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784344.507735:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1790784344.507750:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790784344.507771:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94592d223480 x1877773359537152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790784344.507789:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359537152:0@lo:13: 00000100:00100000:1.0:1790784344.507812:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359536896 00000100:00100000:1.0:1790784344.507829:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359536896 00000100:00100000:1.0:1790784344.507857:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790784344.507864:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906be9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1877773359536896:12345-0@lo:400: 00000100:00100000:1.0:1790784344.507900:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906be9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1877773359536896:12345-0@lo:400: Request processed in 36us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784344.507906:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1790784344.507919:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790784344.507938:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1877773359536896:0@lo:400: 00000100:00100000:1.0:1790784344.507965:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359536384 00000100:00100000:1.0:1790784344.507968:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359536384 00000100:00100000:3.0:1790784344.508145:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359536768 00000100:00100000:3.0:1790784344.508149:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359536768 00000100:00100000:3.0:1790784344.508176:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790784344.508182:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906be9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359536768:12345-0@lo:400: 00000100:00100000:3.0:1790784344.508226:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906be9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359536768:12345-0@lo:400: Request processed in 44us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784344.508233:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790784344.508260:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9459057c1880 x1877773359536768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784344.508270:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359536768:0@lo:400: 00000100:00100000:0.0:1790784344.508615:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784344.508638:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359537024:0@lo:400: 00000100:00100000:0.0:1790784344.508661:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784344.508686:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3280:1877773359536640:0@lo:400: 00000100:00100000:0.0:1790784344.508711:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359536512 00000100:00100000:0.0:1790784344.508714:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359536512 00000100:00100000:0.0:1790784344.508739:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790784344.508745:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1877773359536512:12345-0@lo:400: 00000100:00100000:0.0:1790784344.508779:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1877773359536512:12345-0@lo:400: Request processed in 34us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784344.508785:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790784344.508809:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1877773359536512:0@lo:400: 00000100:00100000:0.0:1790784344.508830:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359537024 00000100:00100000:0.0:1790784344.508833:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359537024 00000100:00100000:0.0:1790784344.508861:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790784344.508868:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359537024:12345-0@lo:400: 00000100:00100000:0.0:1790784344.508900:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359537024:12345-0@lo:400: Request processed in 33us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784344.508906:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1790784344.508920:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790784344.508934:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff945906a72d80 x1877773359537024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784344.508955:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1790784344.508965:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359537024:0@lo:400: 00000100:00100000:1.0:1790784344.509647:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1790784344.509659:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905648450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3281:x1877773359536384:12345-0@lo:400: 00000100:00100000:1.0:1790784344.509717:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905648450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3281:x1877773359536384:12345-0@lo:400: Request processed in 61us (2195us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784344.509723:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1790784344.509798:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359536384:0@lo:400: 00010000:00010000:3.0:1790784344.580218:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790784344.636744:0:6693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b0f9e8c2-ddb0-4027-babe-0b166585860c 00000100:00100000:0.0:1790784345.018956:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906bea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359537280:0@lo:13: 00000100:00100000:0.0:1790784345.019019:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784345.019134:0:8113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906beb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8113:1877773359537408:0@lo:700: 00000100:00100000:1.0:1790784345.019168:0:8113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784345.019195:0:8113:0:(client.c:2716:ptlrpc_set_wait()) set ffff945907d92240 going to sleep for 11 seconds 00000100:00100000:2.0:1790784345.019265:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359537280 00000100:00100000:2.0:1790784345.019288:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359537280 00000100:00100000:2.0:1790784345.019367:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790784345.019397:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359537280:12345-0@lo:13: 00002000:00000024:2.0:1790784345.019459:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44367872 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790784345.019605:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359537408 00000100:00100000:3.0:1790784345.019611:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359537408 00000100:00100000:2.0:1790784345.019617:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1877773359537280:12345-0@lo:13: Request processed in 241us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784345.019626:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790784345.019704:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790784345.019713:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906be9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8113:x1877773359537408:12345-0@lo:700: 00000100:00100000:3.0:1790784345.019742:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d222a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6676:1877773359537536:0@lo:700: 00000100:00100000:3.0:1790784345.019776:0:6676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784345.019811:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593f4810c0 going to sleep for 11 seconds 00010000:00080000:0.0:1790784345.020205:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff945906bea680 x1877773359537280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784345.020224:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906bea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359537280:0@lo:13: 00000100:00100000:2.0:1790784345.020761:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359537536 00000100:00100000:2.0:1790784345.020768:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359537536 00000100:00100000:2.0:1790784345.020813:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790784345.020821:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6676:x1877773359537536:12345-0@lo:700: 40000000:02000000:2.0:1790784345.047218:0:5825:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000001:00100000:0.0:1790784345.047756:0:5841:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b0f9e8c2-ddb0-4027-babe-0b166585860c 00000100:00100000:2.0:1790784345.053748:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6676:x1877773359537536:12345-0@lo:700: Request processed in 32920us (33964us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784345.053763:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790784345.053958:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d222a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6676:1877773359537536:0@lo:700: 40000000:02000000:3.0:1790784345.053972:0:6676:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:2.0:1790784345.098638:0:7614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b0f9e8c2-ddb0-4027-babe-0b166585860c 00000100:00100000:1.0:1790784345.098984:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906be9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8113:x1877773359537408:12345-0@lo:700: Request processed in 79153us (79696us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784345.098997:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790784345.099153:0:8113:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff945906beb800 x1877773359537408/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790784361 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790784345.099167:0:8113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906beb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8113:1877773359537408:0@lo:700: 00000004:02000040:3.0:1790784345.187065:0:8113:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1790784345.198750:0:8113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d222a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8113:1877773359537664:0@lo:5: 00000100:00100000:3.0:1790784345.198808:0:8113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784345.198942:0:8113:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593f481f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790784345.204019:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359537664 00000100:00100000:1.0:1790784345.204178:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359537664 00000100:00100000:0.0:1790784345.205752:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790784345.205822:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8113:x1877773359537664:12345-0@lo:5: 00000100:00100000:3.0:1790784345.211843:0:6669:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1790784345.211857:0:6669:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:2.0:1790784345.216264:0:6668:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1790784345.216285:0:6668:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1790784345.223746:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8113:x1877773359537664:12345-0@lo:5: Request processed in 17974us (24927us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1790784345.223760:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1790784345.224065:0:8113:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94592d222a00 x1877773359537664/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790784361 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790784345.224083:0:8113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d222a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8113:1877773359537664:0@lo:5: 00000004:00080000:1.0:1790784345.224097:0:8113:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1790784345.595338:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790784346.226203:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784346.226309:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344836864 00000100:00100000:2.0:1790784346.226318:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344836864 00000100:00100000:2.0:1790784346.226440:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 9 00000100:00100000:2.0:1790784346.226451:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:5672:x1877773344836864:12345-192.168.206.32@tcp:41: 00000004:00000024:2.0:1790784346.226507:0:5819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1790784346.226566:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:5672:x1877773344836864:12345-192.168.206.32@tcp:41: Request processed in 117us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784346.226574:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 9 00000100:00080000:1.0:1790784346.226873:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790784346.232536:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784346.232640:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344836992 00000100:00100000:1.0:1790784346.232651:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344836992 00000100:00100000:1.0:1790784346.232729:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 9 00000100:00100000:1.0:1790784346.232740:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:5672:x1877773344836992:12345-192.168.206.32@tcp:13: 00002000:00000024:1.0:1790784346.232773:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790784346.232833:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:5672:x1877773344836992:12345-192.168.206.32@tcp:13: Request processed in 96us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784346.232840:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 9 00000100:00080000:0.0:1790784346.233445:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790784346.235121:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784346.235221:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344837120 00000100:00100000:1.0:1790784346.235230:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344837120 00000100:00100000:1.0:1790784346.235299:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 10 00000100:00100000:1.0:1790784346.235309:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:5672:x1877773344837120:12345-192.168.206.32@tcp:13: 00002000:00000024:1.0:1790784346.235333:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1790784346.235472:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790784346.235589:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:5672:x1877773344837120:12345-192.168.206.32@tcp:13: Request processed in 281us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784346.235597:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 10 00010000:00010000:3.0:1790784346.620924:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784347.645657:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790784348.618765:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784348.618848:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784348.618905:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344837248 00000100:00100000:0.0:1790784348.618915:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344837248 00000100:00100000:1.0:1790784348.618940:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784348.618967:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 127 00000100:00100000:1.0:1790784348.618970:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784348.618976:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590564a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:2349:x1877773344837248:12345-192.168.206.32@tcp:400: 00000100:00100000:0.0:1790784348.619048:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590564a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:2349:x1877773344837248:12345-192.168.206.32@tcp:400: Request processed in 73us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784348.619056:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 127 00000100:00100000:0.0:1790784348.619106:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344837376 00000100:00100000:0.0:1790784348.619110:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344837376 00000100:00100000:0.0:1790784348.619146:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 20 00000100:00100000:0.0:1790784348.619168:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2349:x1877773344837376:12345-192.168.206.32@tcp:400: 00000100:00100000:0.0:1790784348.619199:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2349:x1877773344837376:12345-192.168.206.32@tcp:400: Request processed in 33us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784348.619206:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 20 00000100:00080000:0.0:1790784348.619224:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790784348.620392:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344837504 00000100:00100000:2.0:1790784348.620407:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344837504 00000100:00100000:2.0:1790784348.620450:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344837632 00000100:00100000:2.0:1790784348.620454:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344837632 00000100:00100000:2.0:1790784348.620484:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 5 00000100:00080000:3.0:1790784348.620487:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790784348.620491:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790784348.620492:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906bebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2349:x1877773344837504:12345-192.168.206.32@tcp:400: 00000100:00100000:3.0:1790784348.620504:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 6 00000100:00100000:3.0:1790784348.620512:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906beaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2349:x1877773344837632:12345-192.168.206.32@tcp:400: 00000100:00100000:3.0:1790784348.620535:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906beaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2349:x1877773344837632:12345-192.168.206.32@tcp:400: Request processed in 25us (1563us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784348.620542:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 6 00000100:00100000:2.0:1790784348.620548:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906bebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2349:x1877773344837504:12345-192.168.206.32@tcp:400: Request processed in 44us (1687us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784348.620555:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 5 00010000:00010000:3.0:1790784348.666619:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790784349.314234:0:8267:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1790784349.630484:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906be8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359537792:0@lo:400: 00000100:00100000:2.0:1790784349.630551:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906beb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1877773359537920:0@lo:400: 00000100:00100000:1.0:1790784349.630552:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784349.630590:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784349.630608:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1877773359538304:0@lo:400: 00000100:00100000:2.0:1790784349.630618:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359538432:0@lo:400: 00000100:00100000:1.0:1790784349.630640:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784349.630650:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784349.630673:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790784349.630681:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906bea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359538048:0@lo:400: 00000100:00100000:1.0:1790784349.630683:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790784349.630692:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359538176:0@lo:400: 00000100:00100000:2.0:1790784349.630706:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784349.630727:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784349.630741:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359537920 00000100:00100000:2.0:1790784349.630749:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359537920 00000100:00100000:1.0:1790784349.630766:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359537792 00000100:00100000:1.0:1790784349.630772:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359537792 00000100:00100000:2.0:1790784349.630782:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359538304 00000100:00100000:2.0:1790784349.630786:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359538304 00000100:00100000:1.0:1790784349.630812:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1790784349.630815:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359538048 00000100:00100000:2.0:1790784349.630818:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359538048 00000100:00100000:1.0:1790784349.630824:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3282:x1877773359537792:12345-0@lo:400: 00000100:00100000:2.0:1790784349.630845:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790784349.630853:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1877773359537920:12345-0@lo:400: 00000100:00100000:1.0:1790784349.630882:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3282:x1877773359537792:12345-0@lo:400: Request processed in 61us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784349.630891:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1790784349.630900:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1877773359537920:12345-0@lo:400: Request processed in 47us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784349.630908:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790784349.630926:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790784349.630933:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790784349.630934:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1877773359538304:12345-0@lo:400: 00000100:00100000:1.0:1790784349.630948:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359538048:12345-0@lo:400: 00000100:00100000:2.0:1790784349.630965:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1877773359538304:12345-0@lo:400: Request processed in 32us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784349.630985:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790784349.631007:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359538432 00000100:00100000:1.0:1790784349.631008:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359538048:12345-0@lo:400: Request processed in 62us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784349.631012:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359538432 00000100:00100000:1.0:1790784349.631019:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790784349.631040:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359538176 00000100:00100000:2.0:1790784349.631043:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359538176 00000100:00100000:2.0:1790784349.631068:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790784349.631068:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906be8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359537792:0@lo:400: 00000100:00100000:2.0:1790784349.631079:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1877773359538432:12345-0@lo:400: 00000100:00100000:1.0:1790784349.631089:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1877773359538304:0@lo:400: 00000100:00100000:2.0:1790784349.631115:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1877773359538432:12345-0@lo:400: Request processed in 37us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784349.631122:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790784349.631134:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790784349.631140:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359538176:12345-0@lo:400: 00000100:00080000:1.0:1790784349.631146:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790784349.631152:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790784349.631155:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790784349.631174:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359538176:12345-0@lo:400: Request processed in 33us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784349.631180:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1790784349.631211:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9459057c1500 x1877773359538176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790784349.631214:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906bea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359538048:0@lo:400: 00000100:00100000:2.0:1790784349.631228:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906beb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1877773359537920:0@lo:400: 00000100:00100000:1.0:1790784349.631230:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359538176:0@lo:400: 00010000:00080000:2.0:1790784349.631251:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9459057c2a00 x1877773359538432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790784349.631261:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359538432:0@lo:400: 00000100:00100000:2.0:1790784349.631277:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790784349.631283:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d221c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359538560:0@lo:13: 00000100:00100000:2.0:1790784349.631306:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784349.631558:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359538560 00000100:00100000:1.0:1790784349.631562:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359538560 00000100:00100000:1.0:1790784349.631598:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790784349.631604:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359538560:12345-0@lo:13: 00002000:00000024:1.0:1790784349.631636:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790784349.631680:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359538560:12345-0@lo:13: Request processed in 76us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784349.631686:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1790784349.631803:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94592d221c00 x1877773359538560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784349.631817:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d221c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359538560:0@lo:13: 00010000:00010000:0.0:1790784349.694245:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790784350.141798:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359538688:0@lo:13: 00000100:00100000:1.0:1790784350.141857:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784350.141914:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359538688 00000100:00100000:1.0:1790784350.141921:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359538688 00000100:00100000:1.0:1790784350.141958:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790784350.141966:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1877773359538688:12345-0@lo:13: 00002000:00000024:1.0:1790784350.141993:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790784350.142029:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1877773359538688:12345-0@lo:13: Request processed in 63us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784350.142036:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1790784350.142070:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9459057c1500 x1877773359538688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784366 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790784350.142087:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359538688:0@lo:13: 00000001:00080000:1.0:1790784350.278124:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1790784350.715352:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784351.739933:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784352.763434:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790784353.088173:0:8416:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd07975820 20000000:00000080:3.0:1790784353.088189:0:8416:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9459056cfc00 uarg=0000000000000000 20000000:01000000:3.0:1790784353.088228:0:8416:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1790784353.088230:0:8416:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1790784353.088232:0:8416:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1790784353.088237:0:8416:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1790784353.088242:0:8416:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1790784353.088254:0:8416:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1790784353.088256:0:8416:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1790784353.090524:0:8416:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1790784353.090531:0:8416:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1790784353.092748:0:8417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1790784353.095151:0:8416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1790784353.095199:0:8416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1790784353.095229:0:8416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1790784353.095241:0:8416:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1790784353.095244:0:8416:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790784353.097790:0:8418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1790784353.100476:0:8416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1790784353.100557:0:8416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1790784353.100598:0:8416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1790784353.100612:0:8416:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1790784353.100615:0:8416:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1790784353.102167:0:8419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1790784353.103371:0:8416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1790784353.103543:0:8416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1790784353.103591:0:8416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1790784353.103604:0:8416:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1790784353.103618:0:8416:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1790784353.106775:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1790784353.107872:0:8416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1790784353.107964:0:8416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1790784353.108014:0:8416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:2.0:1790784353.108032:0:8416:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1790784353.108056:0:8416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff945909575400/0x2c3a1e2a079d366f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784353.108078:0:8416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff945901524600/0x2c3a1e2a079d356c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3565 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784353.108086:0:8416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff945909574e00/0x2c3a1e2a079d3596 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d358f expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784353.108109:0:8416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94590955ec00/0x2c3a1e2a079d35c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d35b9 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784353.108116:0:8416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff945907103600/0x2c3a1e2a079d35ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d35c7 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784353.108128:0:8416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff945909575800/0x2c3a1e2a079d35dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d35d5 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784353.108136:0:8416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff945907102000/0x2c3a1e2a079d35f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d35f1 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784353.108142:0:8416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff945907102200/0x2c3a1e2a079d3622 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d361b expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784353.108151:0:8416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff945907103200/0x2c3a1e2a079d3630 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134e8c expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784353.108159:0:8416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff945909574400/0x2c3a1e2a079d3637 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134e93 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784353.108166:0:8416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff945909575400/0x2c3a1e2a079d366f lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784353.108200:0:8416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff945909574400/0x2c3a1e2a079d3637 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134e93 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784353.108216:0:8416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff945909574400/0x2c3a1e2a079d3637 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134e93 expref: 9 pid: 5812 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784353.108247:0:8416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1877773359538816:192.168.206.32@tcp:104: 00010000:00010000:2.0:1790784353.108357:0:8416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff945907103200/0x2c3a1e2a079d3630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134e8c expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784353.108366:0:8416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff945907103200/0x2c3a1e2a079d3630 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134e8c expref: 9 pid: 5810 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784353.108411:0:8416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1877773359538944:192.168.206.32@tcp:104: 00010000:00010000:2.0:1790784353.108475:0:8416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff945907102200/0x2c3a1e2a079d3622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d361b expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784353.108485:0:8416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff945907102200/0x2c3a1e2a079d3622 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d361b expref: 18 pid: 5812 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784353.108499:0:8416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa55f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1877773359539072:0@lo:104: 00000100:00100000:2.0:1790784353.108541:0:8416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790784353.108578:0:8416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff945907102000/0x2c3a1e2a079d35f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d35f1 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784353.108593:0:8416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff945907102000/0x2c3a1e2a079d35f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d35f1 expref: 18 pid: 5812 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784353.108601:0:8416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa55c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1877773359539200:0@lo:104: 00000100:00100000:2.0:1790784353.108626:0:8416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790784353.108663:0:8416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff945909575800/0x2c3a1e2a079d35dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d35d5 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784353.108672:0:8416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff945909575800/0x2c3a1e2a079d35dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d35d5 expref: 18 pid: 5812 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784353.108694:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790784353.108695:0:8416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa54700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1877773359539328:0@lo:104: 00000100:00100000:3.0:1790784353.108714:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359539072 00000100:00100000:3.0:1790784353.108722:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359539072 00000100:00100000:2.0:1790784353.108735:0:8416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784353.108760:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359539200 00010000:00010000:2.0:1790784353.108761:0:8416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff945907103600/0x2c3a1e2a079d35ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d35c7 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784353.108772:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359539200 00010000:00010000:2.0:1790784353.108773:0:8416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff945907103600/0x2c3a1e2a079d35ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d35c7 expref: 18 pid: 5812 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784353.108791:0:8416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa55500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1877773359539456:0@lo:104: 00000100:00100000:3.0:1790784353.108793:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359539328 00000100:00100000:3.0:1790784353.108797:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359539328 00000100:00100000:2.0:1790784353.108815:0:8416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784353.108820:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790784353.108831:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+5:8416:x1877773359539072:12345-0@lo:104: 00010000:00010000:2.0:1790784353.108836:0:8416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94590955ec00/0x2c3a1e2a079d35c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d35b9 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.108845:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff945907102c00/0x2c3a1e2a079d361b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d3622 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784353.108846:0:8416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94590955ec00/0x2c3a1e2a079d35c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d35b9 expref: 18 pid: 5811 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784353.108867:0:8416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa54a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1877773359539584:0@lo:104: 00000100:00100000:2.0:1790784353.108887:0:8416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790784353.108906:0:8416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff945909574e00/0x2c3a1e2a079d3596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d358f expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784353.108914:0:8416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff945909574e00/0x2c3a1e2a079d3596 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d358f expref: 18 pid: 5812 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.108921:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790784353.108924:0:8416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa57800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1877773359539712:0@lo:104: 00000100:00100000:3.0:1790784353.108931:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+5:8416:x1877773359539072:12345-0@lo:104: Request processed in 101us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784353.108939:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790784353.108945:0:8416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784353.108958:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359539456 00000100:00100000:3.0:1790784353.108964:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359539456 00010000:00010000:2.0:1790784353.108965:0:8416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff945901524600/0x2c3a1e2a079d356c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d3565 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784353.108978:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359539584 00000100:00100000:3.0:1790784353.108982:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359539584 00010000:00010000:2.0:1790784353.108987:0:8416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff945901524600/0x2c3a1e2a079d356c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3565 expref: 18 pid: 5810 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784353.108995:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359539712 00000100:00100000:2.0:1790784353.108999:0:8416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa56300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1877773359539840:0@lo:104: 00000100:00100000:3.0:1790784353.109000:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359539712 00000100:00100000:3.0:1790784353.109021:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790784353.109027:0:8416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784353.109032:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907d26050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+7:8416:x1877773359539200:12345-0@lo:104: 00000100:00100000:2.0:1790784353.109039:0:8416:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592da29b40 going to sleep for 11 seconds 00010000:00010000:3.0:1790784353.109042:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff945907102e00/0x2c3a1e2a079d35f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d35f8 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784353.109058:0:8416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa55f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1877773359539072:0@lo:104: 00010000:00010000:3.0:1790784353.109095:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790784353.109098:0:8416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa55c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1877773359539200:0@lo:104: 00000100:00100000:3.0:1790784353.109103:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907d26050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+7:8416:x1877773359539200:12345-0@lo:104: Request processed in 75us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784353.109113:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790784353.109148:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359539840 00000100:00100000:3.0:1790784353.109152:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359539840 00000100:00100000:3.0:1790784353.109165:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790784353.109178:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+7:8416:x1877773359539328:12345-0@lo:104: 00010000:00010000:3.0:1790784353.109185:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff945907103800/0x2c3a1e2a079d35d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d35dc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.109225:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1790784353.109230:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+7:8416:x1877773359539328:12345-0@lo:104: Request processed in 54us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784353.109236:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790784353.109249:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790784353.109255:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+6:8416:x1877773359539456:12345-0@lo:104: 00010000:00010000:3.0:1790784353.109262:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d35c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d35ce expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.109287:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1790784353.109291:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+6:8416:x1877773359539456:12345-0@lo:104: Request processed in 37us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784353.109296:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790784353.109306:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790784353.109311:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+5:8416:x1877773359539584:12345-0@lo:104: 00010000:00010000:3.0:1790784353.109318:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d35b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d35c0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.109343:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1790784353.109348:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+5:8416:x1877773359539584:12345-0@lo:104: Request processed in 37us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784353.109353:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790784353.109366:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790784353.109412:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+4:8416:x1877773359539712:12345-0@lo:104: 00010000:00010000:3.0:1790784353.109419:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff94590955f400/0x2c3a1e2a079d358f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d3596 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784353.109521:0:8416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa54700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1877773359539328:0@lo:104: 00000100:00100000:2.0:1790784353.109528:0:8416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa55500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1877773359539456:0@lo:104: 00000100:00100000:2.0:1790784353.109534:0:8416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa54a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1877773359539584:0@lo:104: 00000100:00100000:2.0:1790784353.109540:0:8416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa57800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1877773359539712:0@lo:104: 00010000:00010000:3.0:1790784353.112776:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1790784353.112793:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+4:8416:x1877773359539712:12345-0@lo:104: Request processed in 3378us (3844us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784353.112806:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790784353.112839:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790784353.112850:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+3:8416:x1877773359539840:12345-0@lo:104: 00010000:00010000:3.0:1790784353.112866:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff945907102800/0x2c3a1e2a079d3565 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d356c expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.112923:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1790784353.112928:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+3:8416:x1877773359539840:12345-0@lo:104: Request processed in 83us (3902us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784353.112932:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1790784353.112950:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1790784353.112956:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff945907102c00/0x2c3a1e2a079d361b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d3622 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.112962:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945907102c00 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:3.0:1790784353.112966:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff945907102c00/0x2c3a1e2a079d361b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d3622 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.112975:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff945907102c00/0x2c3a1e2a079d361b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d3622 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790784353.112982:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff945907102c00/0x2c3a1e2a079d361b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d3622 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790784353.113001:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790784353.113047:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff945907102c00/0x2c3a1e2a079d361b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3622 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.113054:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790784353.113078:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff945907102c00/0x2c3a1e2a079d361b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3622 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.113086:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff945907102c00/0x2c3a1e2a079d361b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3622 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.113101:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1790784353.113104:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff945907102e00/0x2c3a1e2a079d35f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d35f8 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.113110:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945907102e00 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:3.0:1790784353.113113:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff945907102e00/0x2c3a1e2a079d35f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d35f8 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.113121:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff945907102e00/0x2c3a1e2a079d35f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d35f8 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790784353.113128:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff945907102e00/0x2c3a1e2a079d35f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d35f8 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790784353.113134:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790784353.113159:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff945907102e00/0x2c3a1e2a079d35f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d35f8 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.113166:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790784353.113179:0:8416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1877773359538816:192.168.206.32@tcp:104: 00010000:00010000:3.0:1790784353.113191:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff945907102e00/0x2c3a1e2a079d35f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d35f8 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784353.113194:0:8416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1877773359538944:192.168.206.32@tcp:104: 00010000:00010000:3.0:1790784353.113205:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff945907102e00/0x2c3a1e2a079d35f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d35f8 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784353.113206:0:8416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa56300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8416:1877773359539840:0@lo:104: 00010000:00010000:3.0:1790784353.113223:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1790784353.113227:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff945907103800/0x2c3a1e2a079d35d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d35dc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.113233:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945907103800 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:3.0:1790784353.113236:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff945907103800/0x2c3a1e2a079d35d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d35dc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.113242:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff945907103800/0x2c3a1e2a079d35d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d35dc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790784353.113249:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff945907103800/0x2c3a1e2a079d35d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d35dc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784353.113251:0:8416:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff945909575400/0x2c3a1e2a079d366f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790784353.113258:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790784353.113277:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff945907103800/0x2c3a1e2a079d35d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d35dc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.113284:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790784353.113289:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff945907103800/0x2c3a1e2a079d35d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d35dc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.113294:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff945907103800/0x2c3a1e2a079d35d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d35dc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.113302:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1790784353.113311:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d35c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d35ce expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.113318:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955ea00 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:3.0:1790784353.113321:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d35c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d35ce expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.113326:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d35c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d35ce expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790784353.113332:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d35c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d35ce expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790784353.113336:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790784353.113364:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d35c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d35ce expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.113370:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790784353.113403:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d35c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d35ce expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.113409:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff94590955ea00/0x2c3a1e2a079d35c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d35ce expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.113420:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790784353.113423:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d35b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d35c0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.113429:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901525a00 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:3.0:1790784353.113431:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d35b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d35c0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.113448:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d35b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d35c0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790784353.113454:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d35b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d35c0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790784353.113459:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790784353.113474:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d35b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d35c0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.113480:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790784353.113485:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d35b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d35c0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.113491:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d35b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d35c0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.113501:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790784353.113504:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff94590955f400/0x2c3a1e2a079d358f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d3596 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.113509:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955f400 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:3.0:1790784353.113511:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff94590955f400/0x2c3a1e2a079d358f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d3596 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.113518:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff94590955f400/0x2c3a1e2a079d358f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d3596 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790784353.113524:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff94590955f400/0x2c3a1e2a079d358f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d3596 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790784353.113534:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790784353.113547:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff94590955f400/0x2c3a1e2a079d358f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3596 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.113552:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790784353.113557:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff94590955f400/0x2c3a1e2a079d358f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3596 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.113562:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff94590955f400/0x2c3a1e2a079d358f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3596 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.113571:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790784353.113574:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff945907102800/0x2c3a1e2a079d3565 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d356c expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.113579:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945907102800 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:3.0:1790784353.113582:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff945907102800/0x2c3a1e2a079d3565 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d356c expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.113587:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff945907102800/0x2c3a1e2a079d3565 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d356c expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790784353.113593:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff945907102800/0x2c3a1e2a079d3565 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d356c expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790784353.113598:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790784353.113610:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff945907102800/0x2c3a1e2a079d3565 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d356c expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.113615:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790784353.113626:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff945907102800/0x2c3a1e2a079d3565 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d356c expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.113632:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff945907102800/0x2c3a1e2a079d3565 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d356c expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.113645:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784353.113646:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784353.113648:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784353.113656:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784353.113668:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359539968:0@lo:103: 00000100:00100000:3.0:1790784353.113705:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784353.113740:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d221c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359540480:0@lo:103: 00000100:00100000:3.0:1790784353.113760:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784353.113781:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790784353.113787:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359540352:0@lo:103: 00000100:00100000:3.0:1790784353.113819:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784353.113849:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359540096:0@lo:103: 00000100:00100000:3.0:1790784353.113871:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784353.113881:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359540608:0@lo:103: 00000100:00100000:3.0:1790784353.113897:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784353.113908:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790784353.113913:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359540224:0@lo:103: 00000100:00100000:3.0:1790784353.113932:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784353.113942:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359540736:0@lo:103: 00000100:00100000:3.0:1790784353.113961:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784353.113988:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359539968 00000100:00100000:3.0:1790784353.113999:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359539968 00010000:00010000:3.0:1790784353.114023:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff945907102200/0x2c3a1e2a079d3622 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d361b expref: 19 pid: 5812 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784353.114039:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359540480 00000100:00100000:3.0:1790784353.114042:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359540480 00010000:00010000:3.0:1790784353.114052:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94590955ec00/0x2c3a1e2a079d35c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d35b9 expref: 20 pid: 5811 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784353.114062:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359540352 00000100:00100000:3.0:1790784353.114064:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359540352 00010000:00010000:3.0:1790784353.114073:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff945907103600/0x2c3a1e2a079d35ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d35c7 expref: 21 pid: 5812 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784353.114082:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359540096 00000100:00100000:3.0:1790784353.114084:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359540096 00010000:00010000:3.0:1790784353.114093:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff945907102000/0x2c3a1e2a079d35f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d35f1 expref: 22 pid: 5812 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784353.114103:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359540608 00000100:00100000:3.0:1790784353.114105:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359540608 00010000:00010000:3.0:1790784353.114115:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff945909574e00/0x2c3a1e2a079d3596 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d358f expref: 23 pid: 5812 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784353.114123:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359540224 00000100:00100000:3.0:1790784353.114125:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359540224 00010000:00010000:3.0:1790784353.114134:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff945909575800/0x2c3a1e2a079d35dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d35d5 expref: 24 pid: 5812 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784353.114142:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359540736 00000100:00100000:3.0:1790784353.114145:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359540736 00010000:00010000:3.0:1790784353.114154:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff945901524600/0x2c3a1e2a079d356c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3565 expref: 25 pid: 5810 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784353.114179:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790784353.114186:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d220380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+25:3282:x1877773359539968:12345-0@lo:103: 00010000:00010000:3.0:1790784353.114198:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784353.114203:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff945907102200/0x2c3a1e2a079d3622 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d361b expref: 25 pid: 5812 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.114211:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff945907102200/0x2c3a1e2a079d3622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d361b expref: 25 pid: 5812 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.114223:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945907102200/0x2c3a1e2a079d3622 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d361b expref: 25 pid: 5812 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.114235:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790784353.114267:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d220380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+24:3282:x1877773359539968:12345-0@lo:103: Request processed in 80us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784353.114273:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790784353.114287:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790784353.114293:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d220e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+23:3282:x1877773359540480:12345-0@lo:103: 00010000:00010000:3.0:1790784353.114301:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784353.114305:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94590955ec00/0x2c3a1e2a079d35c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d35b9 expref: 23 pid: 5811 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.114312:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94590955ec00/0x2c3a1e2a079d35c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d35b9 expref: 23 pid: 5811 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.114322:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94590955ec00/0x2c3a1e2a079d35c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d35b9 expref: 23 pid: 5811 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.114342:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790784353.114369:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d220e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+22:3282:x1877773359540480:12345-0@lo:103: Request processed in 76us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784353.114420:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790784353.114434:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790784353.114441:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f50df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+21:3282:x1877773359540352:12345-0@lo:103: 00010000:00010000:3.0:1790784353.114449:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784353.114454:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff945907103600/0x2c3a1e2a079d35ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d35c7 expref: 21 pid: 5812 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.114463:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff945907103600/0x2c3a1e2a079d35ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d35c7 expref: 21 pid: 5812 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.114473:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945907103600/0x2c3a1e2a079d35ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d35c7 expref: 21 pid: 5812 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.114482:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790784353.114505:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f50df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+20:3282:x1877773359540352:12345-0@lo:103: Request processed in 65us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784353.114511:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790784353.114522:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790784353.114528:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f50f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3279:x1877773359540096:12345-0@lo:103: 00010000:00010000:3.0:1790784353.114546:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784353.114551:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff945907102000/0x2c3a1e2a079d35f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d35f1 expref: 19 pid: 5812 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.114559:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff945907102000/0x2c3a1e2a079d35f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d35f1 expref: 19 pid: 5812 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.114574:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945907102000/0x2c3a1e2a079d35f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d35f1 expref: 19 pid: 5812 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784353.114582:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790784353.115348:0:5803:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1790784353.115358:0:5803:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1790784353.116097:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790784353.116110:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f50dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:3279:x1877773359540608:12345-0@lo:103: 00010000:00010000:1.0:1790784353.116123:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784353.116130:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff945909574e00/0x2c3a1e2a079d3596 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d358f expref: 18 pid: 5812 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784353.116153:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff945909574e00/0x2c3a1e2a079d3596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d358f expref: 18 pid: 5812 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784353.116166:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945909574e00/0x2c3a1e2a079d3596 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d358f expref: 18 pid: 5812 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784353.116179:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790784353.116234:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f50dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:3279:x1877773359540608:12345-0@lo:103: Request processed in 128us (2335us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784353.116240:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790784353.116260:0:5803:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1790784353.116266:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790784353.116272:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f50c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:3279:x1877773359540224:12345-0@lo:103: 00010000:00010000:1.0:1790784353.116279:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784353.116283:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff945909575800/0x2c3a1e2a079d35dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d35d5 expref: 16 pid: 5812 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784353.116291:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff945909575800/0x2c3a1e2a079d35dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d35d5 expref: 16 pid: 5812 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784353.116300:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945909575800/0x2c3a1e2a079d35dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d35d5 expref: 16 pid: 5812 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784353.116309:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790784353.116328:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f50c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:3279:x1877773359540224:12345-0@lo:103: Request processed in 56us (2395us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784353.116334:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790784353.116343:0:5803:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1790784353.116353:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790784353.116360:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905197850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:3279:x1877773359540736:12345-0@lo:103: 00010000:00010000:1.0:1790784353.116366:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784353.116371:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff945901524600/0x2c3a1e2a079d356c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3565 expref: 14 pid: 5810 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784353.116417:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff945901524600/0x2c3a1e2a079d356c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3565 expref: 14 pid: 5810 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784353.116427:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945901524600/0x2c3a1e2a079d356c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d3565 expref: 14 pid: 5810 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784353.116437:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790784353.116458:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905197850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:3279:x1877773359540736:12345-0@lo:103: Request processed in 99us (2496us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784353.116464:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790784353.116653:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359540224:0@lo:103: 00000100:00100000:2.0:1790784353.116662:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359540736:0@lo:103: 00000100:00100000:2.0:1790784353.116669:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d223480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359540608:0@lo:103: 00000100:00100000:3.0:1790784353.118601:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f50f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:3279:x1877773359540096:12345-0@lo:103: Request processed in 4066us (4721us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784353.118613:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790784353.118664:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359540096:0@lo:103: 00000100:00100000:3.0:1790784353.118697:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359540352:0@lo:103: 00000100:00100000:3.0:1790784353.118708:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359539968:0@lo:103: 00000100:00100000:3.0:1790784353.118715:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d221c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359540480:0@lo:103: 00000100:00100000:3.0:1790784353.119742:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784353.120021:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784353.121349:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344837760 00000100:00100000:1.0:1790784353.121360:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344837760 00010000:00010000:1.0:1790784353.121468:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff945909574400/0x2c3a1e2a079d3637 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134e93 expref: 10 pid: 5812 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784353.121499:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344837888 00000100:00100000:1.0:1790784353.121502:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344837888 00010000:00010000:1.0:1790784353.121514:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff945907103200/0x2c3a1e2a079d3630 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134e8c expref: 11 pid: 5810 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784353.121532:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 19 00000100:00100000:1.0:1790784353.121539:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f50df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+11:2351:x1877773344837760:12345-192.168.206.32@tcp:103: 00010000:00010000:1.0:1790784353.121551:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784353.121556:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff945909574400/0x2c3a1e2a079d3637 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134e93 expref: 11 pid: 5812 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784353.121579:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff945909574400/0x2c3a1e2a079d3637 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134e93 expref: 11 pid: 5812 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784353.121595:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945909574400/0x2c3a1e2a079d3637 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134e93 expref: 11 pid: 5812 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784353.121608:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790784353.121661:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f50df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:2351:x1877773344837760:12345-192.168.206.32@tcp:103: Request processed in 123us (1924us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784353.121668:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 19 00000100:00100000:1.0:1790784353.121684:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 20 00000100:00100000:1.0:1790784353.121690:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f50dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+9:2351:x1877773344837888:12345-192.168.206.32@tcp:103: 00010000:00010000:1.0:1790784353.121698:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784353.121702:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff945907103200/0x2c3a1e2a079d3630 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134e8c expref: 9 pid: 5810 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784353.121711:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff945907103200/0x2c3a1e2a079d3630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134e8c expref: 9 pid: 5810 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784353.121721:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945907103200/0x2c3a1e2a079d3630 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134e8c expref: 9 pid: 5810 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784353.121731:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff945909575400/0x2c3a1e2a079d366f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784353.121740:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945909575400/0x2c3a1e2a079d366f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784353.121775:0:5803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff945909575400/0x2c3a1e2a079d366f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784353.121782:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff945909575400/0x2c3a1e2a079d366f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784353.121789:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff945909575400/0x2c3a1e2a079d366f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784353.121796:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff945909575400/0x2c3a1e2a079d366f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784353.121801:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945909575400 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:1.0:1790784353.121805:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff945909575400/0x2c3a1e2a079d366f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784353.121813:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff945909575400/0x2c3a1e2a079d366f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784353.121823:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff945909575400/0x2c3a1e2a079d366f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784353.121832:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790784353.121850:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f50dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+8:2351:x1877773344837888:12345-192.168.206.32@tcp:103: Request processed in 160us (1830us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784353.121856:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 20 00010000:00010000:0.0:1790784353.122268:0:8416:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff945909575400/0x2c3a1e2a079d366f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784353.122278:0:8416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff945909575400/0x2c3a1e2a079d366f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784353.122284:0:8416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945909575400/0x2c3a1e2a079d366f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784353.710799:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784353.710910:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784353.711000:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784353.711208:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784353.711270:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344838272 00000100:00100000:1.0:1790784353.711279:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344838272 00000100:00100000:1.0:1790784353.711330:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344838400 00000100:00100000:1.0:1790784353.711334:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344838400 00000100:00100000:1.0:1790784353.711355:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 9 00000100:00100000:1.0:1790784353.711365:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2349:x1877773344838272:12345-192.168.206.32@tcp:400: 00000100:00100000:1.0:1790784353.711468:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2349:x1877773344838272:12345-192.168.206.32@tcp:400: Request processed in 104us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784353.711476:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 9 00000100:00100000:1.0:1790784353.711494:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 10 00000100:00100000:1.0:1790784353.711501:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2350:x1877773344838400:12345-192.168.206.32@tcp:400: 00000100:00100000:1.0:1790784353.711525:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2350:x1877773344838400:12345-192.168.206.32@tcp:400: Request processed in 26us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784353.711531:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 10 00000100:00080000:1.0:1790784353.711546:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790784353.711550:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790784353.714228:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344838144 00000100:00100000:3.0:1790784353.714253:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344838144 00000100:00100000:3.0:1790784353.714330:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 24 00000100:00100000:3.0:1790784353.714341:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2350:x1877773344838144:12345-192.168.206.32@tcp:400: 00000100:00100000:3.0:1790784353.714445:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2350:x1877773344838144:12345-192.168.206.32@tcp:400: Request processed in 106us (3444us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784353.714452:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 24 00000100:00080000:1.0:1790784353.715329:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790784353.716354:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344838016 00000100:00100000:0.0:1790784353.716363:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344838016 00000100:00100000:0.0:1790784353.716938:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 129 00000100:00100000:0.0:1790784353.716948:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+8:2349:x1877773344838016:12345-192.168.206.32@tcp:400: 00000100:00100000:0.0:1790784353.717019:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+8:2349:x1877773344838016:12345-192.168.206.32@tcp:400: Request processed in 73us (6229us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784353.717026:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 129 00010000:00010000:3.0:1790784353.788213:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784354.746674:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359540992:0@lo:400: 00000100:00100000:1.0:1790784354.749460:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359540864:0@lo:13: 00000100:00100000:1.0:1790784354.749544:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784354.749683:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1877773359541120:0@lo:400: 00000100:00100000:2.0:1790784354.749717:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784354.749743:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790784354.749749:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359541248:0@lo:400: 00000100:00100000:2.0:1790784354.749773:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784354.749804:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359541120 00000100:00100000:2.0:1790784354.749825:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359541120 00000100:00100000:1.0:1790784354.749849:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1877773359541376:0@lo:400: 00000100:00100000:2.0:1790784354.749866:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359541248 00000100:00100000:2.0:1790784354.749871:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359541248 00000100:00100000:2.0:1790784354.749895:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790784354.749902:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1877773359541120:12345-0@lo:400: 00000100:00100000:2.0:1790784354.749949:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1877773359541120:12345-0@lo:400: Request processed in 46us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784354.749956:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790784354.749971:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790784354.749978:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359541248:12345-0@lo:400: 00000100:00100000:2.0:1790784354.750004:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359541248:12345-0@lo:400: Request processed in 27us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784354.750009:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1790784354.750027:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790784354.750045:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784354.750072:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790784354.750079:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359541248:0@lo:400: 00000100:00100000:1.0:1790784354.750081:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359541504:0@lo:400: 00000100:00100000:2.0:1790784354.750099:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1877773359541120:0@lo:400: 00000100:00100000:1.0:1790784354.750116:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784354.750122:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359541376 00000100:00100000:2.0:1790784354.750127:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359541376 00000100:00100000:2.0:1790784354.750162:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790784354.750169:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906beb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1877773359541376:12345-0@lo:400: 00000100:00100000:1.0:1790784354.750181:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359541504 00000100:00100000:1.0:1790784354.750187:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359541504 00000100:00100000:2.0:1790784354.750206:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906beb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1877773359541376:12345-0@lo:400: Request processed in 37us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784354.750213:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1790784354.750227:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790784354.750230:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790784354.750245:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1877773359541376:0@lo:400: 00000100:00100000:1.0:1790784354.750294:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790784354.750310:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906bea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359541504:12345-0@lo:400: 00000100:00100000:1.0:1790784354.750348:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906bea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359541504:12345-0@lo:400: Request processed in 41us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784354.750355:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790784354.750768:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359540864 00000100:00100000:0.0:1790784354.750773:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359540864 00000100:00100000:0.0:1790784354.750815:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790784354.750824:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359540864:12345-0@lo:13: 00002000:00000024:0.0:1790784354.750849:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790784354.750886:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359540864:12345-0@lo:13: Request processed in 63us (1342us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784354.750892:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1790784354.750984:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94591aa54000 x1877773359541504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790784354.751002:0:3281:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1790784354.751014:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359541504:0@lo:400: 00010000:00080000:2.0:1790784354.751027:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593f50c700 x1877773359540864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790784354.751042:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359540864:0@lo:13: 00000100:00100000:3.0:1790784354.752537:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784354.752712:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359540992 00000100:00100000:0.0:1790784354.752722:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359540992 00000100:00100000:0.0:1790784354.752796:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1790784354.752807:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:3282:x1877773359540992:12345-0@lo:400: 00000100:00100000:0.0:1790784354.752890:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:3282:x1877773359540992:12345-0@lo:400: Request processed in 86us (6148us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784354.752898:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:1.0:1790784354.753265:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790784354.753614:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359540992:0@lo:400: 00010000:00010000:3.0:1790784354.814415:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790784354.874516:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790784354.874523:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94593fa9a800 from 39 10000000:01000000:1.0:1790784354.874528:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790784354.874573:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff94590955e400/0x2c3a1e2a079d3676 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784354.874585:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff94590955e400/0x2c3a1e2a079d3676 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784354.874596:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff94590955e400/0x2c3a1e2a079d3676 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784354.874618:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906be8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359541632:0@lo:101: 00000100:00100000:1.0:1790784354.874687:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784354.874768:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459050a9540 going to sleep for 11 seconds 00000100:00100000:0.0:1790784354.874945:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359541632 00000100:00100000:0.0:1790784354.874952:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359541632 00000100:00100000:0.0:1790784354.875009:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1790784354.875019:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+12:5815:x1877773359541632:12345-0@lo:101: 00010000:00010000:0.0:1790784354.875108:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784354.875122:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945907102a00/0x2c3a1e2a079d367d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d3676 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784354.875144:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945907102a00/0x2c3a1e2a079d367d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3676 expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784354.875155:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945907102a00/0x2c3a1e2a079d367d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3676 expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784354.875164:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945907102a00, rc 0) 00000100:00100000:0.0:1790784354.875220:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:5815:x1877773359541632:12345-0@lo:101: Request processed in 203us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784354.875227:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1790784354.875275:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906be8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359541632:0@lo:101: 00010000:00010000:2.0:1790784354.875306:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff94590955e400/0x2c3a1e2a079d3676 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d367d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784354.875326:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff94590955e400/0x2c3a1e2a079d3676 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d367d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784354.875432:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359541760:0@lo:501: 00000100:00100000:2.0:1790784354.875461:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784354.875493:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592da29240 going to sleep for 11 seconds 00000100:00100000:1.0:1790784354.875657:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359541760 00000100:00100000:1.0:1790784354.875662:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359541760 00000100:00100000:1.0:1790784354.875698:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1790784354.875705:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:5815:x1877773359541760:12345-0@lo:501: 00000100:00100000:1.0:1790784354.875935:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:5815:x1877773359541760:12345-0@lo:501: Request processed in 229us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784354.875943:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1790784354.876018:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359541760:0@lo:501: 00000100:00100000:2.0:1790784354.876044:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359541888:0@lo:503: 00000100:00100000:2.0:1790784354.876198:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784354.876221:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592da29240 going to sleep for 11 seconds 00000100:00100000:0.0:1790784354.876285:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359541888 00000100:00100000:0.0:1790784354.876290:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359541888 00000100:00100000:0.0:1790784354.876329:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1790784354.876335:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:5815:x1877773359541888:12345-0@lo:503: 00000100:00100000:0.0:1790784354.877132:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:5815:x1877773359541888:12345-0@lo:503: Request processed in 795us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784354.877140:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1790784354.877949:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359541888:0@lo:503: 00000100:00100000:3.0:1790784354.879083:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f50f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8433:1877773359542016:0@lo:502: 00000100:00100000:3.0:1790784354.879143:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784354.879181:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593f481d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790784354.879441:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359542016 00000100:00100000:1.0:1790784354.879447:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359542016 00000100:00100000:1.0:1790784354.879500:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1790784354.879509:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:8433:x1877773359542016:12345-0@lo:502: 00000100:00100000:1.0:1790784354.879725:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:8433:x1877773359542016:12345-0@lo:502: Request processed in 216us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784354.879732:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1790784354.879934:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f50f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8433:1877773359542016:0@lo:502: 00000100:00100000:3.0:1790784354.879978:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f50f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8433:1877773359542144:0@lo:502: 00000100:00100000:3.0:1790784354.880011:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784354.880041:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592d54ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1790784354.880196:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359542144 00000100:00100000:2.0:1790784354.880201:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359542144 00000100:00100000:2.0:1790784354.880236:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1790784354.880243:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:8433:x1877773359542144:12345-0@lo:502: 00000100:00100000:2.0:1790784354.880599:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:8433:x1877773359542144:12345-0@lo:502: Request processed in 356us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784354.880612:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1790784354.884696:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f50f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8433:1877773359542144:0@lo:502: 00000040:00080000:3.0:1790784354.884747:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1790784354.885030:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1790784354.885065:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790784354.885074:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff94590955e400/0x2c3a1e2a079d3676 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d367d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784354.885085:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff94590955e400/0x2c3a1e2a079d3676 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d367d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790784354.885094:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1790784354.885096:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1790784354.885098:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1790784354.885133:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945909575000/0x2c3a1e2a079d3684 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784354.885140:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff945909575000/0x2c3a1e2a079d3684 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784354.885148:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff945909575000/0x2c3a1e2a079d3684 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784354.885164:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa57b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359542272:0@lo:101: 00000100:00100000:2.0:1790784354.885218:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784354.885261:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592da29540 going to sleep for 11 seconds 00000100:00100000:0.0:1790784354.885501:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359542272 00000100:00100000:0.0:1790784354.885508:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359542272 00000100:00100000:0.0:1790784354.885555:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1790784354.885565:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+13:5815:x1877773359542272:12345-0@lo:101: 00010000:00010000:0.0:1790784354.885577:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784354.885589:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945907103a00/0x2c3a1e2a079d368b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d3684 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784354.885628:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945907103a00/0x2c3a1e2a079d368b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3684 expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784354.885638:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945907103a00/0x2c3a1e2a079d368b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3684 expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784354.885646:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945907103a00, rc 0) 00000100:00100000:0.0:1790784354.885697:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:5815:x1877773359542272:12345-0@lo:101: Request processed in 133us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784354.885704:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1790784354.885847:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa57b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359542272:0@lo:101: 00010000:00010000:1.0:1790784354.885860:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff945909575000/0x2c3a1e2a079d3684 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d368b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784354.885868:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff945909575000/0x2c3a1e2a079d3684 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d368b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784354.885929:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906be8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359542400:0@lo:501: 00000100:00100000:1.0:1790784354.885955:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784354.885984:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff945906b8b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790784354.886039:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359542400 00000100:00100000:0.0:1790784354.886043:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359542400 00000100:00100000:0.0:1790784354.886079:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1790784354.886086:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:5815:x1877773359542400:12345-0@lo:501: 00000100:00100000:0.0:1790784354.886316:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:5815:x1877773359542400:12345-0@lo:501: Request processed in 230us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784354.886565:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1790784354.886600:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906be8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359542400:0@lo:501: 00000100:00100000:0.0:1790784354.886632:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359542528:0@lo:503: 00000100:00100000:0.0:1790784354.886668:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784354.886689:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff945903313600 going to sleep for 11 seconds 00000100:00100000:0.0:1790784354.886701:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359542528 00000100:00100000:0.0:1790784354.886704:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359542528 00000100:00100000:0.0:1790784354.886721:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1790784354.886726:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:5815:x1877773359542528:12345-0@lo:503: 00000100:00100000:0.0:1790784354.886854:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:5815:x1877773359542528:12345-0@lo:503: Request processed in 126us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784354.886866:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1790784354.886899:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359542528:0@lo:503: 00000100:00100000:0.0:1790784354.889586:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8434:1877773359542656:0@lo:502: 00000100:00100000:0.0:1790784354.889671:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784354.889707:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459102b5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790784354.889973:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359542656 00000100:00100000:1.0:1790784354.889980:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359542656 00000100:00100000:1.0:1790784354.890030:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1790784354.890039:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:8434:x1877773359542656:12345-0@lo:502: 00000100:00100000:1.0:1790784354.890275:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:8434:x1877773359542656:12345-0@lo:502: Request processed in 236us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784354.890292:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1790784354.890847:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8434:1877773359542656:0@lo:502: 00000020:01000000:2.0:1790784354.890878:0:8434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790784354.890886:0:8434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784354.890888:0:8434:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790784354.890894:0:8434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1790784354.890925:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa56a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8434:1877773359542784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790784354.890962:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784354.890985:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592da29540 going to sleep for 11 seconds 00000100:00100000:0.0:1790784354.891453:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359542784 00000100:00100000:0.0:1790784354.891460:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359542784 00000100:00100000:0.0:1790784354.891506:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790784354.891514:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:8434:x1877773359542784:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790784354.891671:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:8434:x1877773359542784:12345-0@lo:502:llog_process_th.0 Request processed in 157us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784354.891678:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1790784354.891835:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa56a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8434:1877773359542784:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790784354.891858:0:8434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790784354.891862:0:8434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784354.891865:0:8434:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790784354.891869:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1790784354.892913:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1790784354.892937:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1790784354.892947:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945909575000/0x2c3a1e2a079d3684 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d368b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784354.892960:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff945909575000/0x2c3a1e2a079d3684 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d368b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790784354.892970:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790784354.892973:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9459050db000 from 39 10000000:01000000:0.0:1790784354.892976:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790784354.893004:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945907103000/0x2c3a1e2a079d3692 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784354.893013:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff945907103000/0x2c3a1e2a079d3692 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784354.893032:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff945907103000/0x2c3a1e2a079d3692 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784354.893061:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359542912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790784354.893106:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784354.893144:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459102b5180 going to sleep for 11 seconds 00000100:00100000:1.0:1790784354.893203:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359542912 00000100:00100000:1.0:1790784354.893209:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359542912 00000100:00100000:1.0:1790784354.893251:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1790784354.893260:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:5815:x1877773359542912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790784354.893270:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784354.893298:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94590955ee00/0x2c3a1e2a079d3699 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d3692 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784354.893326:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94590955ee00/0x2c3a1e2a079d3699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3692 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784354.893338:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94590955ee00/0x2c3a1e2a079d3699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3692 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784354.893346:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94590955ee00, rc 0) 00000100:00100000:1.0:1790784354.893576:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:5815:x1877773359542912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 317us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784354.893584:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1790784354.893771:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359542912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790784354.893784:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff945907103000/0x2c3a1e2a079d3692 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3699 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784354.893793:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff945907103000/0x2c3a1e2a079d3692 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d3699 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784354.893837:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359543040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790784354.893859:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784354.893885:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459102b5180 going to sleep for 11 seconds 00000100:00100000:1.0:1790784354.895091:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359543040 00000100:00100000:1.0:1790784354.895100:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359543040 00000100:00100000:1.0:1790784354.895149:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790784354.895157:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:5815:x1877773359543040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790784354.895717:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:5815:x1877773359543040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 559us (1856us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784354.895725:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1790784354.895807:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359543040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790784354.895846:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359543168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790784354.895884:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784354.895915:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459102b5180 going to sleep for 11 seconds 00000100:00100000:2.0:1790784354.895955:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359543168 00000100:00100000:2.0:1790784354.895959:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359543168 00000100:00100000:2.0:1790784354.895988:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1790784354.895995:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:5815:x1877773359543168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790784354.896137:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:5815:x1877773359543168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784354.896144:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1790784354.897609:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359543168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790784354.898646:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906be8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8435:1877773359543296:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790784354.898718:0:8435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784354.898764:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592d92b840 going to sleep for 11 seconds 00000100:00100000:2.0:1790784354.899189:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359543296 00000100:00100000:2.0:1790784354.899197:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359543296 00000100:00100000:2.0:1790784354.899248:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1790784354.899258:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:8435:x1877773359543296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790784354.899815:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:8435:x1877773359543296:12345-0@lo:502:llog_process_th.0 Request processed in 556us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784354.899824:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1790784354.905302:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906be8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8435:1877773359543296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790784354.905732:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8435:1877773359543424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790784354.905803:0:8435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784354.905894:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459102b5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790784354.909323:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359543424 00000100:00100000:1.0:1790784354.909336:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359543424 00000100:00100000:1.0:1790784354.909638:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790784354.909650:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:8435:x1877773359543424:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790784354.909919:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:8435:x1877773359543424:12345-0@lo:502:llog_process_th.0 Request processed in 272us (4116us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784354.909927:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1790784354.910087:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8435:1877773359543424:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1790784354.910117:0:8435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1790784354.910594:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1790784354.910615:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790784354.910624:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945907103000/0x2c3a1e2a079d3692 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3699 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784354.910635:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff945907103000/0x2c3a1e2a079d3692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3699 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790784354.910644:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1790784354.910647:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1790784354.910650:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1790784354.910677:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff94590955f200/0x2c3a1e2a079d36a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784354.910685:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff94590955f200/0x2c3a1e2a079d36a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784354.910694:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff94590955f200/0x2c3a1e2a079d36a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784354.910714:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906be8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359543552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790784354.910751:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784354.910788:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592d92bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1790784354.910929:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359543552 00000100:00100000:2.0:1790784354.910935:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359543552 00000100:00100000:2.0:1790784354.910974:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1790784354.910981:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:5815:x1877773359543552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790784354.910991:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784354.911008:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945909574c00/0x2c3a1e2a079d36a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d36a0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784354.911028:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945909574c00/0x2c3a1e2a079d36a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d36a0 expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784354.911038:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945909574c00/0x2c3a1e2a079d36a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d36a0 expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784354.911064:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945909574c00, rc 0) 00000100:00100000:2.0:1790784354.911103:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:5815:x1877773359543552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784354.911110:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1790784354.911171:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906be8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359543552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790784354.911185:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff94590955f200/0x2c3a1e2a079d36a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d36a7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784354.911194:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff94590955f200/0x2c3a1e2a079d36a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d36a7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784354.911237:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359543680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790784354.911262:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784354.911291:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459102b5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790784354.911703:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359543680 00000100:00100000:2.0:1790784354.911708:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359543680 00000100:00100000:2.0:1790784354.911741:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1790784354.911748:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:5815:x1877773359543680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790784354.911962:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:5815:x1877773359543680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 214us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784354.911969:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1790784354.912073:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359543680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790784354.912103:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359543808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790784354.912137:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784354.912164:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459102b5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790784354.912300:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359543808 00000100:00100000:2.0:1790784354.912304:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359543808 00000100:00100000:2.0:1790784354.912340:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790784354.912347:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:5815:x1877773359543808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790784354.912895:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:5815:x1877773359543808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 547us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784354.912904:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1790784354.914931:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359543808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790784354.920769:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa56a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8436:1877773359543936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790784354.920857:0:8436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784354.920896:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592da290c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790784354.921629:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359543936 00000100:00100000:3.0:1790784354.921639:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359543936 00000100:00100000:3.0:1790784354.921681:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1790784354.921689:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:8436:x1877773359543936:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790784354.921910:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:8436:x1877773359543936:12345-0@lo:502:llog_process_th.0 Request processed in 222us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784354.921919:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790784354.922010:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa56a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8436:1877773359543936:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790784354.922038:0:8436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790784354.922058:0:8436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790784354.922067:0:8436:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790784354.922074:0:8436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1790784354.922098:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8436:1877773359544064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790784354.922135:0:8436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784354.922167:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459102b5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790784354.922329:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359544064 00000100:00100000:1.0:1790784354.922333:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359544064 00000100:00100000:1.0:1790784354.922398:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1790784354.922421:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:8436:x1877773359544064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790784354.922544:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:8436:x1877773359544064:12345-0@lo:502:llog_process_th.0 Request processed in 123us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784354.922551:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790784354.922905:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8436:1877773359544064:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790784354.922926:0:8436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790784354.922931:0:8436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790784354.922933:0:8436:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790784354.922937:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1790784354.924011:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1790784354.924039:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1790784354.924184:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff94590955f200/0x2c3a1e2a079d36a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d36a7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784354.924199:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff94590955f200/0x2c3a1e2a079d36a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d36a7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790784354.924210:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790784354.924213:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff945905fd5000 from 39 10000000:01000000:1.0:1790784354.924217:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790784354.924249:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff94590955fc00/0x2c3a1e2a079d36ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784354.924258:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff94590955fc00/0x2c3a1e2a079d36ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784354.924268:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff94590955fc00/0x2c3a1e2a079d36ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784354.924300:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906be8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359544192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790784354.924355:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784354.924668:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592d92b780 going to sleep for 11 seconds 00000100:00100000:0.0:1790784354.924764:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359544192 00000100:00100000:0.0:1790784354.924770:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359544192 00000100:00100000:0.0:1790784354.924813:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1790784354.924821:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:5815:x1877773359544192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790784354.924832:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784354.924844:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945907103200/0x2c3a1e2a079d36b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d36ae expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784354.924867:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945907103200/0x2c3a1e2a079d36b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d36ae expref: 17 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784354.924878:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945907103200/0x2c3a1e2a079d36b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d36ae expref: 17 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784354.924887:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945907103200, rc 0) 00000100:00100000:0.0:1790784354.924929:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:5815:x1877773359544192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784354.924936:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1790784354.925040:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906be8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359544192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790784354.925204:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff94590955fc00/0x2c3a1e2a079d36ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d36b5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784354.925214:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff94590955fc00/0x2c3a1e2a079d36ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d36b5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784354.925265:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906be8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359544320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790784354.925524:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784354.925547:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592d92b780 going to sleep for 11 seconds 00000100:00100000:3.0:1790784354.925643:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359544320 00000100:00100000:3.0:1790784354.925648:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359544320 00000100:00100000:3.0:1790784354.925680:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1790784354.925688:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:5815:x1877773359544320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790784354.925924:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:5815:x1877773359544320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784354.925931:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1790784354.926005:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906be8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359544320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790784354.926034:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906be8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359544448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790784354.926996:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784354.927022:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592d92b780 going to sleep for 11 seconds 00000100:00100000:3.0:1790784354.927945:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359544448 00000100:00100000:3.0:1790784354.927964:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359544448 00000100:00100000:3.0:1790784354.928011:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790784354.928020:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:5815:x1877773359544448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790784354.928219:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:5815:x1877773359544448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 200us (1226us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784354.928227:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1790784354.928729:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906be8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359544448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790784354.932210:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784354.932530:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344838528 00000100:00100000:2.0:1790784354.932539:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344838528 00000100:00100000:2.0:1790784354.932595:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 154 00000100:00100000:2.0:1790784354.932605:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+8:5593:x1877773344838528:12345-192.168.206.32@tcp:101: 00010000:00010000:2.0:1790784354.932619:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784354.932636:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945909575400/0x2c3a1e2a079d36bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x394e0d8838134ef5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784354.932662:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945909575400/0x2c3a1e2a079d36bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134ef5 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784354.932673:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945909575400/0x2c3a1e2a079d36bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134ef5 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784354.932681:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945909575400, rc 0) 00000100:00100000:2.0:1790784354.932743:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+9:5593:x1877773344838528:12345-192.168.206.32@tcp:101: Request processed in 135us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784354.932750:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 154 00000100:00100000:0.0:1790784354.932970:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8437:1877773359544576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790784354.933024:0:8437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784354.933071:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459102b5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790784354.934184:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359544576 00000100:00100000:2.0:1790784354.934193:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359544576 00000100:00100000:2.0:1790784354.934238:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1790784354.934246:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:8437:x1877773359544576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790784354.934648:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:8437:x1877773359544576:12345-0@lo:502:llog_process_th.0 Request processed in 403us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784354.934656:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1790784354.935187:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8437:1877773359544576:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790784354.935252:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906be8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8437:1877773359544704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790784354.935305:0:8437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784354.935347:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592d92b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790784354.936336:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359544704 00000100:00100000:3.0:1790784354.936344:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359544704 00000100:00100000:3.0:1790784354.936427:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790784354.936437:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:8437:x1877773359544704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790784354.936658:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:8437:x1877773359544704:12345-0@lo:502:llog_process_th.0 Request processed in 222us (1351us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784354.936665:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1790784354.936912:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784354.937141:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344838656 00000100:00100000:1.0:1790784354.937146:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344838656 00000100:00100000:1.0:1790784354.937167:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 157 00000100:00100000:1.0:1790784354.937174:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+9:5593:x1877773344838656:12345-192.168.206.32@tcp:501: 00000100:00100000:1.0:1790784354.937436:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+9:5593:x1877773344838656:12345-192.168.206.32@tcp:501: Request processed in 260us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784354.937443:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 157 00000100:00100000:1.0:1790784354.937490:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906be8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8437:1877773359544704:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1790784354.937523:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1790784354.938399:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1790784354.938420:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790784354.938429:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff94590955fc00/0x2c3a1e2a079d36ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d36b5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784354.938440:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff94590955fc00/0x2c3a1e2a079d36ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d36b5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790784354.938449:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1790784354.938451:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1790784354.938454:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1790784354.938483:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945909574400/0x2c3a1e2a079d36c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784354.938491:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff945909574400/0x2c3a1e2a079d36c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784354.938500:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff945909574400/0x2c3a1e2a079d36c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784354.938518:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359544832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790784354.938558:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784354.938591:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592da299c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790784354.938608:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359544832 00000100:00100000:2.0:1790784354.938612:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359544832 00000100:00100000:2.0:1790784354.938641:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790784354.938648:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:5815:x1877773359544832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790784354.938656:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784354.938667:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945909575800/0x2c3a1e2a079d36ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d36c3 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784354.938701:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945909575800/0x2c3a1e2a079d36ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d36c3 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784354.938710:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945909575800/0x2c3a1e2a079d36ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d36c3 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784354.938718:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945909575800, rc 0) 00000100:00100000:2.0:1790784354.938750:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:5815:x1877773359544832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784354.938756:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790784354.938790:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359544832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790784354.938802:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff945909574400/0x2c3a1e2a079d36c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d36ca expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784354.938811:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff945909574400/0x2c3a1e2a079d36c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d36ca expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784354.938852:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359544960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790784354.938876:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784354.938889:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592da299c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790784354.938899:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359544960 00000100:00100000:2.0:1790784354.938903:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359544960 00000100:00100000:2.0:1790784354.938918:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790784354.938924:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:5815:x1877773359544960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790784354.941291:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:5815:x1877773359544960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2360us (2407us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784354.941314:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790784354.941459:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa54380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359544960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790784354.941511:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359545088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790784354.941553:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784354.941583:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459102b5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790784354.941887:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359545088 00000100:00100000:3.0:1790784354.941895:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359545088 00000100:00100000:3.0:1790784354.941939:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1790784354.941948:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903694c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:5815:x1877773359545088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790784354.942116:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903694c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:5815:x1877773359545088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784354.942122:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790784354.942298:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359545088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790784354.943130:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906be8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8438:1877773359545216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790784354.943175:0:8438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784354.943207:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592d92b480 going to sleep for 11 seconds 00000100:00100000:3.0:1790784354.943255:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359545216 00000100:00100000:3.0:1790784354.943260:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359545216 00000100:00100000:3.0:1790784354.943300:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1790784354.943308:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:8438:x1877773359545216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790784354.943537:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:8438:x1877773359545216:12345-0@lo:502:llog_process_th.0 Request processed in 229us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784354.943554:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1790784354.943813:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906be8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8438:1877773359545216:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790784354.943839:0:8438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790784354.943846:0:8438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790784354.943849:0:8438:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790784354.943855:0:8438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790784354.943872:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906be8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8438:1877773359545344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790784354.943903:0:8438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784354.943920:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592d92b480 going to sleep for 11 seconds 00000100:00100000:2.0:1790784354.943976:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359545344 00000100:00100000:2.0:1790784354.943981:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359545344 00000100:00100000:2.0:1790784354.944011:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1790784354.944018:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:8438:x1877773359545344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790784354.944152:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:8438:x1877773359545344:12345-0@lo:502:llog_process_th.0 Request processed in 134us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784354.944160:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1790784354.944231:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906be8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8438:1877773359545344:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790784354.944249:0:8438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790784354.944254:0:8438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790784354.944255:0:8438:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790784354.944259:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1790784354.945490:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1790784354.945517:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790784354.945527:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945909574400/0x2c3a1e2a079d36c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d36ca expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784354.945539:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff945909574400/0x2c3a1e2a079d36c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d36ca expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790784354.945549:0:5815:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1790784354.945551:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9459057499c0 from 1 10000000:01000000:2.0:1790784354.945554:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790784354.945584:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945909574e00/0x2c3a1e2a079d36d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784354.945592:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff945909574e00/0x2c3a1e2a079d36d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784354.945602:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff945909574e00/0x2c3a1e2a079d36d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784354.945620:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa54a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359545472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790784354.945671:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784354.945706:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592da296c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790784354.945792:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359545472 00000100:00100000:0.0:1790784354.945798:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359545472 00000100:00100000:0.0:1790784354.945837:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1790784354.945845:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:5815:x1877773359545472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790784354.945855:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784354.945867:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945907103600/0x2c3a1e2a079d36d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d36d1 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784354.945887:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945907103600/0x2c3a1e2a079d36d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d36d1 expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784354.945897:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945907103600/0x2c3a1e2a079d36d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d36d1 expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784354.945906:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945907103600, rc 0) 00000100:00100000:0.0:1790784354.945934:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:5815:x1877773359545472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784354.945950:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1790784354.946730:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784354.946917:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344838784 00000100:00100000:0.0:1790784354.946924:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344838784 00000100:00100000:0.0:1790784354.946960:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 164 00000100:00100000:0.0:1790784354.946967:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+9:5593:x1877773344838784:12345-192.168.206.32@tcp:503: 00000100:00100000:0.0:1790784354.947159:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+9:5593:x1877773344838784:12345-192.168.206.32@tcp:503: Request processed in 191us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784354.947167:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 164 00000100:00100000:2.0:1790784354.947287:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa54a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359545472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790784354.947306:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff945909574e00/0x2c3a1e2a079d36d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d36d8 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784354.947316:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff945909574e00/0x2c3a1e2a079d36d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d36d8 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784354.947403:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa54a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359545600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790784354.947436:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784354.947465:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592da296c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790784354.948399:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359545600 00000100:00100000:1.0:1790784354.948407:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359545600 00000100:00100000:1.0:1790784354.948442:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1790784354.948450:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:5815:x1877773359545600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790784354.948659:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:5815:x1877773359545600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 210us (1222us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790784354.948667:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1790784354.949055:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa54a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359545600:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1790784354.949087:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790784354.949095:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945909574e00/0x2c3a1e2a079d36d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d36d8 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784354.949105:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff945909574e00/0x2c3a1e2a079d36d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d36d8 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784354.953215:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784354.953299:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344838912 00000100:00100000:1.0:1790784354.953308:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344838912 00000100:00100000:1.0:1790784354.953412:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 166 00000100:00100000:1.0:1790784354.953424:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+9:6066:x1877773344838912:12345-192.168.206.32@tcp:502: 00000100:00100000:1.0:1790784354.953673:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+9:6066:x1877773344838912:12345-192.168.206.32@tcp:502: Request processed in 250us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784354.953687:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 166 00000100:00100000:3.0:1790784354.959343:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784354.959564:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344839040 00000100:00100000:2.0:1790784354.959573:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344839040 00000100:00100000:2.0:1790784354.959612:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 167 00000100:00100000:2.0:1790784354.959620:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903696c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+9:6066:x1877773344839040:12345-192.168.206.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790784354.959840:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903696c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+9:6066:x1877773344839040:12345-192.168.206.32@tcp:502:llog_process_th.0 Request processed in 220us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784354.959848:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 167 00000100:00100000:3.0:1790784354.969682:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784354.971243:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344839168 00000100:00100000:0.0:1790784354.971255:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344839168 00000100:00100000:0.0:1790784354.971319:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 168 00000100:00100000:0.0:1790784354.971329:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903694850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+9:5593:x1877773344839168:12345-192.168.206.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790784354.971344:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784354.971360:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945907102200/0x2c3a1e2a079d36df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x394e0d8838134efc expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784354.971429:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945907102200/0x2c3a1e2a079d36df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134efc expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784354.971441:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945907102200/0x2c3a1e2a079d36df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134efc expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784354.971450:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945907102200, rc 0) 00000100:00100000:0.0:1790784354.971498:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903694850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:5593:x1877773344839168:12345-192.168.206.32@tcp:101:ll_cfg_requeue.0 Request processed in 171us (1824us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784354.971504:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 168 00000100:00100000:3.0:1790784354.981900:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784354.982290:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344839296 00000100:00100000:1.0:1790784354.982300:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344839296 00000100:00100000:1.0:1790784354.982354:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 169 00000100:00100000:1.0:1790784354.982553:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:5593:x1877773344839296:12345-192.168.206.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790784354.982863:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:5593:x1877773344839296:12345-192.168.206.32@tcp:501:ll_cfg_requeue.0 Request processed in 500us (970us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790784354.982871:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 169 00000100:00100000:2.0:1790784355.259716:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359545728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790784355.259827:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784355.260569:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359545728 00000100:00100000:0.0:1790784355.260578:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359545728 00000100:00100000:0.0:1790784355.260621:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790784355.260641:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359545728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790784355.260676:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790784355.260752:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359545728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784355.260760:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1790784355.260805:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94591aa55500 x1877773359545728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784355.260824:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359545728:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790784355.835133:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790784356.492261:0:8478:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffded7c66a0 20000000:00000080:2.0:1790784356.492287:0:8478:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94592d92dc00 uarg=0000000000000000 20000000:01000000:2.0:1790784356.492334:0:8478:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790784356.492342:0:8478:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790784356.492347:0:8478:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1790784356.498957:0:8479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1790784356.502498:0:8478:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1790784356.511220:0:8478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1790784356.511280:0:8478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1790784356.511605:0:8478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1790784356.511623:0:8478:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790784356.511642:0:8478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff945907102600/0x2c3a1e2a079d36e6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784356.511658:0:8478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff945900030e00/0x2c3a1e2a079d345b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3454 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784356.511665:0:8478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff945909575200/0x2c3a1e2a079d34bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d34b6 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784356.511671:0:8478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff945901524800/0x2c3a1e2a079d3588 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3581 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784356.511679:0:8478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff945907103c00/0x2c3a1e2a079d3645 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134ec4 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784356.511698:0:8478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff945907102600/0x2c3a1e2a079d36e6 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784356.511731:0:8478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff945907103c00/0x2c3a1e2a079d3645 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134ec4 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784356.511745:0:8478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff945907103c00/0x2c3a1e2a079d3645 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134ec4 expref: 9 pid: 5810 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784356.511758:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8478:1877773359545856:192.168.206.32@tcp:104: 00010000:00010000:0.0:1790784356.511960:0:8478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff945901524800/0x2c3a1e2a079d3588 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d3581 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784356.511969:0:8478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff945901524800/0x2c3a1e2a079d3588 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3581 expref: 18 pid: 5811 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784356.511979:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8478:1877773359545984:0@lo:104: 00000100:00100000:0.0:1790784356.512016:0:8478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790784356.512053:0:8478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff945909575200/0x2c3a1e2a079d34bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d34b6 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784356.512065:0:8478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff945909575200/0x2c3a1e2a079d34bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d34b6 expref: 18 pid: 5811 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784356.512075:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8478:1877773359546112:0@lo:104: 00000100:00100000:1.0:1790784356.512089:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359545984 00000100:00100000:0.0:1790784356.512105:0:8478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784356.512106:0:5800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359545984 00010000:00010000:0.0:1790784356.512143:0:8478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff945900030e00/0x2c3a1e2a079d345b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d3454 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784356.512167:0:8478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff945900030e00/0x2c3a1e2a079d345b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3454 expref: 18 pid: 5810 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784356.512178:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8478:1877773359546240:0@lo:104: 00000100:00100000:1.0:1790784356.512180:0:5800:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1790784356.512207:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359546112 00000100:00100000:1.0:1790784356.512212:0:5800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359546112 00000100:00100000:0.0:1790784356.512217:0:8478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784356.512239:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359546240 00000100:00100000:0.0:1790784356.512239:0:8478:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592d92b840 going to sleep for 11 seconds 00000100:00100000:1.0:1790784356.512246:0:5800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359546240 00000100:00100000:1.0:1790784356.512299:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790784356.513625:0:5800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+5:8478:x1877773359545984:12345-0@lo:104: 00010000:00010000:0.0:1790784356.513643:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff94590955f800/0x2c3a1e2a079d3581 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d3588 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784356.513712:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790784356.513719:0:5800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+5:8478:x1877773359545984:12345-0@lo:104: Request processed in 1410us (1703us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784356.513728:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790784356.513760:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790784356.513769:0:5800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056cd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+4:8478:x1877773359546112:12345-0@lo:104: 00010000:00010000:0.0:1790784356.513776:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff945900031c00/0x2c3a1e2a079d34b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d34bd expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784356.513808:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790784356.513812:0:5800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056cd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+4:8478:x1877773359546112:12345-0@lo:104: Request processed in 46us (1709us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784356.513817:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790784356.513845:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790784356.513851:0:5800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+3:8478:x1877773359546240:12345-0@lo:104: 00010000:00010000:0.0:1790784356.513859:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff945909574600/0x2c3a1e2a079d3454 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d345b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784356.513896:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790784356.513901:0:5800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+3:8478:x1877773359546240:12345-0@lo:104: Request processed in 51us (1686us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784356.513907:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1790784356.514177:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790784356.514185:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff94590955f800/0x2c3a1e2a079d3581 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d3588 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784356.514192:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955f800 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:3.0:1790784356.514197:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff94590955f800/0x2c3a1e2a079d3581 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d3588 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784356.514206:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff94590955f800/0x2c3a1e2a079d3581 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d3588 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790784356.514214:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff94590955f800/0x2c3a1e2a079d3581 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d3588 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790784356.514229:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790784356.514270:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff94590955f800/0x2c3a1e2a079d3581 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3588 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784356.514277:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790784356.514296:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff94590955f800/0x2c3a1e2a079d3581 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3588 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784356.514303:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff94590955f800/0x2c3a1e2a079d3581 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3588 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784356.514318:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790784356.514321:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff945900031c00/0x2c3a1e2a079d34b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d34bd expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784356.514339:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900031c00 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:3.0:1790784356.514342:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff945900031c00/0x2c3a1e2a079d34b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d34bd expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784356.514350:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff945900031c00/0x2c3a1e2a079d34b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d34bd expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790784356.514367:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff945900031c00/0x2c3a1e2a079d34b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d34bd expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790784356.514372:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790784356.514422:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff945900031c00/0x2c3a1e2a079d34b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d34bd expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784356.514428:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790784356.515426:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1790784356.515541:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff945900031c00/0x2c3a1e2a079d34b6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d34bd expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784356.515551:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff945900031c00/0x2c3a1e2a079d34b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d34bd expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784356.515565:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790784356.515568:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff945909574600/0x2c3a1e2a079d3454 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d345b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784356.515574:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945909574600 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:3.0:1790784356.515577:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff945909574600/0x2c3a1e2a079d3454 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d345b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784356.515585:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff945909574600/0x2c3a1e2a079d3454 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d345b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790784356.515591:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff945909574600/0x2c3a1e2a079d3454 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d345b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790784356.515596:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790784356.515622:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff945909574600/0x2c3a1e2a079d3454 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d345b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784356.515628:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790784356.515636:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff945909574600/0x2c3a1e2a079d3454 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d345b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784356.515642:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff945909574600/0x2c3a1e2a079d3454 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d345b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784356.515656:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784356.515665:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784356.515667:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784356.515675:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784356.515686:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359546624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790784356.515735:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784356.515775:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790784356.515781:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f50d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359546496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790784356.515801:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784356.515847:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8478:1877773359545984:0@lo:104: 00000100:00100000:3.0:1790784356.515858:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8478:1877773359546112:0@lo:104: 00000100:00100000:3.0:1790784356.515866:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8478:1877773359546240:0@lo:104: 00000100:00100000:0.0:1790784356.515909:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f50f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359546368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790784356.515935:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784356.515996:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359546624 00000100:00100000:0.0:1790784356.516002:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359546624 00010000:00010000:0.0:1790784356.516029:0:8421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff945900030e00/0x2c3a1e2a079d345b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3454 expref: 19 pid: 5810 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784356.516052:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359546496 00000100:00100000:0.0:1790784356.516055:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359546496 00010000:00010000:0.0:1790784356.516066:0:8421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff945909575200/0x2c3a1e2a079d34bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d34b6 expref: 20 pid: 5811 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784356.516076:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359546368 00000100:00100000:0.0:1790784356.516078:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359546368 00010000:00010000:0.0:1790784356.516090:0:8421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff945901524800/0x2c3a1e2a079d3588 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3581 expref: 21 pid: 5811 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784356.516106:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790784356.516114:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f50d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+21:3282:x1877773359546624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790784356.516126:0:8421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784356.516132:0:8421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff945900030e00/0x2c3a1e2a079d345b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3454 expref: 21 pid: 5810 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784356.516142:0:8421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff945900030e00/0x2c3a1e2a079d345b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3454 expref: 21 pid: 5810 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784356.516164:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945900030e00/0x2c3a1e2a079d345b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d3454 expref: 21 pid: 5810 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784356.516178:0:8421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790784356.516225:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f50d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+20:3282:x1877773359546624:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784356.516240:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790784356.516396:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f50ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+20:3282:x1877773359546496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790784356.516417:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784356.516428:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff945909575200/0x2c3a1e2a079d34bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d34b6 expref: 20 pid: 5811 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784356.516443:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff945909575200/0x2c3a1e2a079d34bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d34b6 expref: 20 pid: 5811 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784356.516462:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945909575200/0x2c3a1e2a079d34bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d34b6 expref: 20 pid: 5811 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784356.516495:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790784356.516561:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f50ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3282:x1877773359546496:12345-0@lo:103:ldlm_bl.0 Request processed in 206us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784356.517114:0:5802:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1790784356.517126:0:5802:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:0.0:1790784356.517228:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790784356.517256:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790784356.517266:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:3279:x1877773359546368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790784356.517278:0:8421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784356.517285:0:8421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff945901524800/0x2c3a1e2a079d3588 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3581 expref: 18 pid: 5811 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784356.517295:0:8421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff945901524800/0x2c3a1e2a079d3588 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3581 expref: 18 pid: 5811 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784356.517308:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945901524800/0x2c3a1e2a079d3588 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d3581 expref: 18 pid: 5811 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784356.517320:0:8421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790784356.517404:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:3279:x1877773359546368:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (1466us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784356.517410:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790784356.517809:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f50d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359546496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790784356.517824:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359546624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790784356.517955:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f50f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359546368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790784356.525633:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784356.525872:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8478:1877773359545856:192.168.206.32@tcp:104: 00010000:00010000:3.0:1790784356.525913:0:8478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff945907102600/0x2c3a1e2a079d36e6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784356.525957:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344839424 00000100:00100000:2.0:1790784356.525972:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344839424 00010000:00010000:2.0:1790784356.526026:0:8421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff945907103c00/0x2c3a1e2a079d3645 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134ec4 expref: 10 pid: 5810 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784356.526083:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 24 00000100:00100000:2.0:1790784356.526094:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d1e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:2351:x1877773344839424:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790784356.526112:0:8421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784356.526119:0:8421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff945907103c00/0x2c3a1e2a079d3645 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134ec4 expref: 10 pid: 5810 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784356.526133:0:8421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff945907103c00/0x2c3a1e2a079d3645 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134ec4 expref: 10 pid: 5810 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784356.526154:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945907103c00/0x2c3a1e2a079d3645 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134ec4 expref: 10 pid: 5810 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784356.526173:0:8421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff945907102600/0x2c3a1e2a079d36e6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784356.526183:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945907102600/0x2c3a1e2a079d36e6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784356.526202:0:8421:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff945907102600/0x2c3a1e2a079d36e6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784356.526209:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff945907102600/0x2c3a1e2a079d36e6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784356.526216:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff945907102600/0x2c3a1e2a079d36e6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784356.526239:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff945907102600/0x2c3a1e2a079d36e6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784356.526246:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945907102600 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:2.0:1790784356.526251:0:8421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff945907102600/0x2c3a1e2a079d36e6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784356.526260:0:8421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff945907102600/0x2c3a1e2a079d36e6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784356.526290:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff945907102600/0x2c3a1e2a079d36e6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784356.526302:0:8421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790784356.526406:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d1e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+9:2351:x1877773344839424:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 313us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784356.526414:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 24 00000100:00100000:1.0:1790784356.529576:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1790784356.530922:0:8478:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff945907102600/0x2c3a1e2a079d36e6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784356.530943:0:8478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff945907102600/0x2c3a1e2a079d36e6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784356.530952:0:8478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945907102600/0x2c3a1e2a079d36e6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790784356.647473:0:5815:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790784356.647480:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94593fa9a800 from 4 10000000:01000000:3.0:1790784356.647485:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790784356.647527:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d36ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784356.647539:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d36ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784356.647551:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d36ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784356.647573:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f50e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359546752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790784356.647642:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784356.649604:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592d511000 going to sleep for 11 seconds 00000100:00100000:2.0:1790784356.650673:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359546752 00000100:00100000:2.0:1790784356.650685:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359546752 00000100:00100000:2.0:1790784356.650743:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1790784356.650755:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:5815:x1877773359546752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790784356.650771:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784356.650789:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94593fe75800/0x2c3a1e2a079d36f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d36ed expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784356.650814:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94593fe75800/0x2c3a1e2a079d36f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d36ed expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784356.650826:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94593fe75800/0x2c3a1e2a079d36f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d36ed expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784356.650843:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe75800, rc 0) 00000100:00100000:2.0:1790784356.650913:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:5815:x1877773359546752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (3269us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784356.650921:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1790784356.651244:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f50e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359546752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790784356.651262:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d36ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d36f4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784356.651272:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d36ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d36f4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784356.651337:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906be8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359546880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790784356.651399:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784356.651427:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459183eed80 going to sleep for 11 seconds 00000100:00100000:2.0:1790784356.651618:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359546880 00000100:00100000:2.0:1790784356.651624:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359546880 00000100:00100000:2.0:1790784356.651659:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1790784356.651666:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:5815:x1877773359546880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790784356.651964:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:5815:x1877773359546880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 298us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784356.651979:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1790784356.653404:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906be8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359546880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790784356.653452:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906be8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359547008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790784356.653501:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784356.653533:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459183eed80 going to sleep for 11 seconds 00000100:00100000:1.0:1790784356.654629:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359547008 00000100:00100000:1.0:1790784356.654639:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359547008 00000100:00100000:1.0:1790784356.654720:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1790784356.654731:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:5815:x1877773359547008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790784356.654931:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:5815:x1877773359547008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 202us (1429us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784356.654939:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1790784356.654957:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906be8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359547008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790784356.655308:0:8490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906be8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8490:1877773359547136:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790784356.655339:0:8490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784356.655403:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359547136 00000100:00100000:1.0:1790784356.655406:0:8490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459183eed80 going to sleep for 11 seconds 00000100:00100000:2.0:1790784356.655408:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359547136 00000100:00100000:2.0:1790784356.655438:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1790784356.655446:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:8490:x1877773359547136:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790784356.655588:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:8490:x1877773359547136:12345-0@lo:502:llog_process_th.0 Request processed in 143us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784356.655596:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1790784356.655608:0:8490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906be8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8490:1877773359547136:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790784356.655633:0:8490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790784356.655643:0:8490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790784356.655645:0:8490:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790784356.655653:0:8490:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94593fa9a800 00000020:00000080:1.0:1790784356.655655:0:8490:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790784356.655745:0:8490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906be8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8490:1877773359547264:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790784356.655777:0:8490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784356.655803:0:8490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459183eed80 going to sleep for 11 seconds 00000100:00100000:0.0:1790784356.657307:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359547264 00000100:00100000:0.0:1790784356.657318:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359547264 00000100:00100000:0.0:1790784356.657389:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1790784356.657399:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:8490:x1877773359547264:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790784356.657610:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:8490:x1877773359547264:12345-0@lo:502:llog_process_th.0 Request processed in 212us (1832us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784356.657618:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1790784356.657853:0:8490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906be8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8490:1877773359547264:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790784356.657896:0:8490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790784356.657903:0:8490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790784356.657905:0:8490:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1790784356.657909:0:8490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1790784356.658073:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1790784356.658092:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790784356.658103:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d36ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d36f4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784356.658114:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d36ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d36f4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790784356.658124:0:5815:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790784356.658127:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9459050db000 from 4 10000000:01000000:0.0:1790784356.658130:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790784356.658156:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945907102600/0x2c3a1e2a079d36fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784356.658168:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff945907102600/0x2c3a1e2a079d36fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784356.658178:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff945907102600/0x2c3a1e2a079d36fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784356.658302:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359547392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790784356.658340:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784356.659317:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592da299c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790784356.659340:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359547392 00000100:00100000:0.0:1790784356.659346:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359547392 00000100:00100000:0.0:1790784356.659565:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1790784356.659574:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:5815:x1877773359547392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790784356.659586:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784356.659602:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945907103e00/0x2c3a1e2a079d3702 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d36fb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784356.659626:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945907103e00/0x2c3a1e2a079d3702 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d36fb expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784356.659636:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945907103e00/0x2c3a1e2a079d3702 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d36fb expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784356.659644:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945907103e00, rc 0) 00000100:00100000:0.0:1790784356.659689:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:5815:x1877773359547392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (1348us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784356.659696:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1790784356.659750:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359547392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790784356.659763:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff945907102600/0x2c3a1e2a079d36fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3702 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784356.659773:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff945907102600/0x2c3a1e2a079d36fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d3702 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784356.659825:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359547520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790784356.659850:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784356.659865:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592da299c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790784356.659877:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359547520 00000100:00100000:0.0:1790784356.659880:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359547520 00000100:00100000:0.0:1790784356.659902:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1790784356.659908:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:5815:x1877773359547520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790784356.660117:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:5815:x1877773359547520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 208us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784356.660124:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1790784356.660154:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359547520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790784356.660179:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359547648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790784356.660227:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784356.660256:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592da299c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790784356.660333:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359547648 00000100:00100000:2.0:1790784356.660337:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359547648 00000100:00100000:2.0:1790784356.660372:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1790784356.660398:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:5815:x1877773359547648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790784356.660540:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:5815:x1877773359547648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784356.660553:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1790784356.661642:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359547648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790784356.663014:0:8492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8492:1877773359547776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790784356.663078:0:8492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784356.665463:0:8492:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592da29c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790784356.665647:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359547776 00000100:00100000:1.0:1790784356.665656:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359547776 00000100:00100000:1.0:1790784356.665709:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1790784356.665720:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:8492:x1877773359547776:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790784356.665966:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:8492:x1877773359547776:12345-0@lo:502:llog_process_th.0 Request processed in 247us (2886us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784356.665973:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1790784356.666303:0:8492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8492:1877773359547776:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790784356.666345:0:8492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790784356.666369:0:8492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790784356.666372:0:8492:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790784356.666432:0:8492:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9459050db000 00000020:00000080:0.0:1790784356.666434:0:8492:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790784356.666529:0:8492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8492:1877773359547904:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790784356.666566:0:8492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784356.666586:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359547904 00000100:00100000:0.0:1790784356.666589:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359547904 00000100:00100000:0.0:1790784356.666609:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1790784356.666614:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:8492:x1877773359547904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790784356.666732:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:8492:x1877773359547904:12345-0@lo:502:llog_process_th.0 Request processed in 116us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784356.666739:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1790784356.666773:0:8492:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592da29c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790784356.666784:0:8492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8492:1877773359547904:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790784356.666804:0:8492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790784356.666808:0:8492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790784356.666810:0:8492:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1790784356.666814:0:8492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1790784356.667579:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1790784356.667606:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790784356.667616:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945907102600/0x2c3a1e2a079d36fb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3702 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784356.667627:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff945907102600/0x2c3a1e2a079d36fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3702 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790784356.667637:0:5815:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790784356.667639:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff945905fd5000 from 4 10000000:01000000:2.0:1790784356.667642:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790784356.667666:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff94593fe74400/0x2c3a1e2a079d3709 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784356.667675:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff94593fe74400/0x2c3a1e2a079d3709 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784356.667683:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff94593fe74400/0x2c3a1e2a079d3709 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784356.667700:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359548032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790784356.667737:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784356.667765:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff94590706e540 going to sleep for 11 seconds 00000100:00100000:2.0:1790784356.667779:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359548032 00000100:00100000:2.0:1790784356.667783:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359548032 00000100:00100000:2.0:1790784356.667812:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1790784356.667818:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:5815:x1877773359548032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790784356.667826:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784356.667842:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94593fe74e00/0x2c3a1e2a079d3710 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d3709 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784356.667863:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94593fe74e00/0x2c3a1e2a079d3710 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3709 expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784356.667873:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94593fe74e00/0x2c3a1e2a079d3710 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3709 expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784356.667881:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74e00, rc 0) 00000100:00100000:2.0:1790784356.667912:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:5815:x1877773359548032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784356.667918:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1790784356.667952:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359548032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790784356.667964:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff94593fe74400/0x2c3a1e2a079d3709 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3710 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784356.667973:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff94593fe74400/0x2c3a1e2a079d3709 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d3710 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784356.668015:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359548160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790784356.668036:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784356.668051:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459051ad000 going to sleep for 11 seconds 00000100:00100000:2.0:1790784356.668063:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359548160 00000100:00100000:2.0:1790784356.668066:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359548160 00000100:00100000:2.0:1790784356.668086:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1790784356.668091:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:5815:x1877773359548160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790784356.668292:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:5815:x1877773359548160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 200us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784356.668305:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1790784356.668334:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359548160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790784356.668395:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359548288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790784356.668433:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784356.668447:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359548288 00000100:00100000:1.0:1790784356.668451:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359548288 00000100:00100000:2.0:1790784356.668464:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459051ad000 going to sleep for 11 seconds 00000100:00100000:1.0:1790784356.668474:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1790784356.668480:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:5815:x1877773359548288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790784356.669247:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:5815:x1877773359548288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 763us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784356.669256:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1790784356.670471:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359548288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790784356.674835:0:8495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f50f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8495:1877773359548416:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790784356.674908:0:8495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784356.674950:0:8495:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592d511240 going to sleep for 11 seconds 00000100:00100000:1.0:1790784356.674998:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359548416 00000100:00100000:1.0:1790784356.675005:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359548416 00000100:00100000:1.0:1790784356.675047:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1790784356.675055:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:8495:x1877773359548416:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790784356.675264:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:8495:x1877773359548416:12345-0@lo:502:llog_process_th.0 Request processed in 208us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784356.675272:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1790784356.675364:0:8495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f50f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8495:1877773359548416:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790784356.675421:0:8495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790784356.675429:0:8495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790784356.675431:0:8495:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790784356.675437:0:8495:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff945905fd5000 00000020:00000080:3.0:1790784356.675440:0:8495:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790784356.675511:0:8495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f50f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8495:1877773359548544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790784356.675543:0:8495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784356.675566:0:8495:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592d511240 going to sleep for 11 seconds 00000100:00100000:2.0:1790784356.675584:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359548544 00000100:00100000:2.0:1790784356.675590:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359548544 00000100:00100000:2.0:1790784356.675674:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1790784356.675684:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:8495:x1877773359548544:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790784356.675813:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:8495:x1877773359548544:12345-0@lo:502:llog_process_th.0 Request processed in 131us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784356.675821:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1790784356.675954:0:8495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f50f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:8495:1877773359548544:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790784356.675988:0:8495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790784356.675994:0:8495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790784356.675996:0:8495:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1790784356.676001:0:8495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1790784356.676137:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1790784356.676157:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790784356.676167:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff94593fe74400/0x2c3a1e2a079d3709 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3710 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784356.676179:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff94593fe74400/0x2c3a1e2a079d3709 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3710 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784356.864252:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784357.884539:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784358.252182:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784358.252270:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344839552 00000100:00100000:0.0:1790784358.252281:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344839552 00000100:00100000:0.0:1790784358.252337:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 185 00000100:00100000:0.0:1790784358.252356:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905f9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+9:5593:x1877773344839552:12345-192.168.206.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790784358.252371:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784358.252418:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945907102800/0x2c3a1e2a079d3717 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x394e0d8838134f03 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784358.252457:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945907102800/0x2c3a1e2a079d3717 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f03 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784358.252469:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945907102800/0x2c3a1e2a079d3717 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f03 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784358.252477:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945907102800, rc 0) 00000100:00100000:0.0:1790784358.252526:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905f9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:5593:x1877773344839552:12345-192.168.206.32@tcp:101:ll_cfg_requeue.0 Request processed in 181us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784358.252533:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 185 00000100:00100000:3.0:1790784358.265676:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784358.266954:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344839680 00000100:00100000:1.0:1790784358.266966:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344839680 00000100:00100000:1.0:1790784358.267016:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 186 00000100:00100000:1.0:1790784358.267025:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905f9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:5593:x1877773344839680:12345-192.168.206.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790784358.267279:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905f9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:5593:x1877773344839680:12345-192.168.206.32@tcp:501:ll_cfg_requeue.0 Request processed in 254us (1611us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784358.267287:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 186 00000100:00100000:0.0:1790784358.277994:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784358.278081:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344839808 00000100:00100000:3.0:1790784358.278091:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344839808 00000100:00100000:3.0:1790784358.278145:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 187 00000100:00100000:3.0:1790784358.278156:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:5593:x1877773344839808:12345-192.168.206.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790784358.278435:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:5593:x1877773344839808:12345-192.168.206.32@tcp:503:ll_cfg_requeue.0 Request processed in 281us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784358.278443:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 187 00000100:00100000:3.0:1790784358.291738:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784358.291845:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344839936 00000100:00100000:0.0:1790784358.291854:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344839936 00000100:00100000:0.0:1790784358.291909:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 188 00000100:00100000:0.0:1790784358.291918:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590564b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:6130:x1877773344839936:12345-192.168.206.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790784358.292153:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590564b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:6130:x1877773344839936:12345-192.168.206.32@tcp:502:llog_process_th.0 Request processed in 235us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784358.292161:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 188 00000100:00100000:2.0:1790784358.301560:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784358.301650:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344840064 00000100:00100000:1.0:1790784358.301660:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344840064 00000100:00100000:1.0:1790784358.301714:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 189 00000100:00100000:1.0:1790784358.301723:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:6130:x1877773344840064:12345-192.168.206.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790784358.301964:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:6130:x1877773344840064:12345-192.168.206.32@tcp:502:llog_process_th.0 Request processed in 240us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784358.301971:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 189 00000100:00100000:1.0:1790784358.828439:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784358.828493:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784358.828519:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784358.828562:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784358.828590:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344840192 00000100:00100000:1.0:1790784358.828598:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344840192 00000100:00100000:1.0:1790784358.828642:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 190 00000100:00100000:2.0:1790784358.828650:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344840576 00000100:00100000:1.0:1790784358.828651:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905648450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:2350:x1877773344840192:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1790784358.828654:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344840576 00000100:00100000:2.0:1790784358.828686:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344840448 00000100:00100000:2.0:1790784358.828689:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344840448 00000100:00100000:2.0:1790784358.828709:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 12 00000100:00100000:1.0:1790784358.828710:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905648450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:2350:x1877773344840192:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 60us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784358.828716:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459102ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2350:x1877773344840576:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784358.828717:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 190 00000100:00080000:1.0:1790784358.828767:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790784358.828771:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790784358.828782:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 13 00000100:00100000:1.0:1790784358.828790:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459102eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2350:x1877773344840448:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784358.828814:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459102eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2350:x1877773344840448:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 26us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784358.828815:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459102ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2350:x1877773344840576:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 98us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784358.828822:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 13 00000100:00100000:3.0:1790784358.828865:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344840320 00000100:00100000:3.0:1790784358.828870:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344840320 00000100:00100000:3.0:1790784358.828904:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 28 00000100:00100000:3.0:1790784358.828911:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906be8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2350:x1877773344840320:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1790784358.828938:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906be8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2350:x1877773344840320:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 28us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784358.828944:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 28 00000100:00080000:1.0:1790784358.829762:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790784358.832116:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 12 00010000:00010000:3.0:1790784358.909914:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784359.867485:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790784359.867525:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359548672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790784359.867613:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784359.867690:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359548672 00000100:00100000:2.0:1790784359.867699:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359548672 00000100:00100000:2.0:1790784359.867766:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790784359.867776:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359548672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790784359.867826:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790784359.867877:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359548672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784359.867884:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1790784359.867909:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790784359.867943:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94591aa55c00 x1877773359548672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790784359.867965:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359548672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790784359.868453:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459102e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3282:1877773359549056:0@lo:400:kworker.0 00000100:00100000:1.0:1790784359.868499:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784359.868525:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790784359.868531:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459102eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1877773359548928:0@lo:400:kworker.0 00000100:00100000:1.0:1790784359.868556:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784359.868587:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359549056 00000100:00100000:1.0:1790784359.868593:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359549056 00000100:00100000:1.0:1790784359.868633:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359548928 00000100:00100000:1.0:1790784359.868636:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359548928 00000100:00100000:1.0:1790784359.868666:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790784359.868674:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459102e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1877773359549056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784359.868719:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459102e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1877773359549056:12345-0@lo:400:kworker.0 Request processed in 46us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784359.868726:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790784359.868741:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790784359.868748:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459102eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1877773359548928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784359.868776:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459102eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1877773359548928:12345-0@lo:400:kworker.0 Request processed in 29us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784359.868782:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790784359.868836:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459102eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1877773359548928:0@lo:400:kworker.0 00000100:00100000:1.0:1790784359.868848:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459102e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3282:1877773359549056:0@lo:400:kworker.0 00000100:00100000:0.0:1790784359.869044:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459102ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1877773359549184:0@lo:400:kworker.0 00000100:00100000:0.0:1790784359.869091:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784359.869114:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790784359.869121:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459102e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359548800:0@lo:400:kworker.0 00000100:00100000:0.0:1790784359.869153:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784359.869184:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459102e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359549312:0@lo:400:kworker.0 00000100:00100000:0.0:1790784359.869211:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784359.869255:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359548800 00000100:00100000:0.0:1790784359.869261:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359548800 00000100:00100000:0.0:1790784359.869299:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1790784359.869306:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590564a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3279:x1877773359548800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784359.869358:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590564a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3279:x1877773359548800:12345-0@lo:400:kworker.0 Request processed in 52us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784359.869365:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1790784359.869428:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359549312 00000100:00100000:0.0:1790784359.869432:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359549312 00000100:00100000:0.0:1790784359.869461:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790784359.869467:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359549312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784359.869496:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359549312:12345-0@lo:400:kworker.0 Request processed in 29us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784359.869502:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790784359.869530:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459102e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359548800:0@lo:400:kworker.0 00010000:00080000:0.0:1790784359.869542:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9459102e8000 x1877773359549312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784359.869553:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459102e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359549312:0@lo:400:kworker.0 00000100:00100000:1.0:1790784359.869910:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359549184 00000100:00100000:1.0:1790784359.869916:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359549184 00000100:00100000:1.0:1790784359.869957:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790784359.869965:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d1e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1877773359549184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784359.870015:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d1e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1877773359549184:12345-0@lo:400:kworker.0 Request processed in 51us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784359.870021:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1790784359.870253:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790784359.870260:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790784359.871025:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459102ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1877773359549184:0@lo:400:kworker.0 00010000:00010000:1.0:1790784359.931146:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784360.382456:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790784360.382486:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359549440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790784360.382585:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784360.382929:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359549440 00000100:00100000:3.0:1790784360.382939:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359549440 00000100:00100000:3.0:1790784360.382995:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790784360.383006:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f50ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359549440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790784360.383048:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790784360.383120:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f50ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359549440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784360.383128:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1790784360.383178:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593f50f800 x1877773359549440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784360.383201:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359549440:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790784360.957049:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784361.988881:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784363.023429:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784363.947867:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784363.948009:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784363.948086:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784363.948119:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784363.948149:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344840960 00000100:00100000:3.0:1790784363.948157:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344840960 00000100:00100000:2.0:1790784363.948170:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344840704 00000100:00100000:2.0:1790784363.948177:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344840704 00000100:00100000:2.0:1790784363.948216:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 192 00000100:00100000:3.0:1790784363.948219:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344841088 00000100:00100000:3.0:1790784363.948223:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344841088 00000100:00100000:2.0:1790784363.948229:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:2349:x1877773344840704:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1790784363.948251:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 15 00000100:00100000:3.0:1790784363.948260:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f50f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2349:x1877773344840960:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1790784363.948298:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:2349:x1877773344840704:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 72us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784363.948307:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 192 00000100:00100000:3.0:1790784363.948329:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f50f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2349:x1877773344840960:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 50us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784363.948337:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 15 00000100:00100000:3.0:1790784363.948355:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 16 00000100:00100000:3.0:1790784363.948362:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f50f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2349:x1877773344841088:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1790784363.948412:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f50f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2349:x1877773344841088:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 50us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784363.948420:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 16 00000100:00100000:3.0:1790784363.948438:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344840832 00000100:00100000:3.0:1790784363.948448:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344840832 00000100:00100000:3.0:1790784363.948479:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 32 00000100:00100000:3.0:1790784363.948500:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f50e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2349:x1877773344840832:12345-192.168.206.32@tcp:400:kworker.0 00000100:00080000:2.0:1790784363.948506:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790784363.948512:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790784363.948515:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790784363.948538:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f50e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2349:x1877773344840832:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 52us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784363.948618:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 32 00010000:00010000:1.0:1790784364.033937:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790784364.586294:0:8778:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg632-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1790784364.987674:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459102e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359549952:0@lo:400:kworker.0 00000100:00100000:1.0:1790784364.987740:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784364.987805:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790784364.987812:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459102e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359549568:0@lo:400:kworker.0 00000100:00100000:1.0:1790784364.987841:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784364.987864:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459102e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1877773359550080:0@lo:400:kworker.0 00000100:00100000:1.0:1790784364.987887:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784364.987913:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459102eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1877773359549696:0@lo:400:kworker.0 00000100:00100000:1.0:1790784364.987936:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784364.987964:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459102e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359550208:0@lo:400:kworker.0 00000100:00100000:1.0:1790784364.987986:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784364.988055:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790784364.988061:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459102e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359549824:0@lo:400:kworker.0 00000100:00100000:1.0:1790784364.988083:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784364.988110:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359549952 00000100:00100000:1.0:1790784364.988117:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359549952 00000100:00100000:1.0:1790784364.988164:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359550208 00000100:00100000:1.0:1790784364.988167:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359550208 00000100:00100000:1.0:1790784364.988191:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790784364.988201:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459102e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359549952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784364.988251:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459102e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359549952:12345-0@lo:400:kworker.0 Request processed in 52us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784364.988258:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790784364.988275:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790784364.988281:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459102eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359550208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784364.988323:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459102eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359550208:12345-0@lo:400:kworker.0 Request processed in 42us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784364.988329:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790784364.988353:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359549568 00000100:00100000:1.0:1790784364.988356:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359549568 00000100:00100000:1.0:1790784364.988402:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1790784364.988409:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3281:x1877773359549568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784364.988439:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3281:x1877773359549568:12345-0@lo:400:kworker.0 Request processed in 30us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784364.988444:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1790784364.988468:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359550080 00000100:00100000:1.0:1790784364.988472:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359550080 00000100:00100000:1.0:1790784364.988488:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359549696 00000100:00100000:1.0:1790784364.988490:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359549696 00000100:00100000:1.0:1790784364.988500:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359549824 00000100:00100000:1.0:1790784364.988502:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359549824 00000100:00100000:1.0:1790784364.988515:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790784364.988520:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459102e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1877773359550080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784364.988548:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459102e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1877773359550080:12345-0@lo:400:kworker.0 Request processed in 28us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784364.988554:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790784364.988565:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790784364.988570:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459102ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1877773359549696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784364.988594:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459102ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1877773359549696:12345-0@lo:400:kworker.0 Request processed in 24us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784364.988600:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790784364.988610:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790784364.988616:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459102ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359549824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784364.988638:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459102ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359549824:12345-0@lo:400:kworker.0 Request processed in 23us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784364.988652:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790784364.988686:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459102e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359549824:0@lo:400:kworker.0 00000100:00100000:1.0:1790784364.988696:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459102eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1877773359549696:0@lo:400:kworker.0 00010000:00080000:1.0:1790784364.988707:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9459102e9500 x1877773359550208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790784364.988717:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459102e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359550208:0@lo:400:kworker.0 00000100:00100000:1.0:1790784364.988742:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459102e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359549568:0@lo:400:kworker.0 00000100:00100000:1.0:1790784364.988751:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459102e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1877773359550080:0@lo:400:kworker.0 00010000:00080000:1.0:1790784364.988759:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9459102e8700 x1877773359549952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790784364.988768:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459102e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359549952:0@lo:400:kworker.0 00000100:00080000:2.0:1790784364.990970:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790784364.990993:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790784364.990996:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790784364.997760:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359550336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790784364.997820:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784364.997947:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359550336 00000100:00100000:1.0:1790784364.997955:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359550336 00000100:00100000:1.0:1790784364.998042:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790784364.998052:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f50ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359550336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790784364.998082:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790784364.998180:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f50ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359550336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784364.998187:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1790784364.998243:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94592d1e1180 x1877773359550336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784364.998261:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359550336:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790784365.050713:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790784365.503559:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359550464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790784365.503624:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784365.505865:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359550464 00000100:00100000:0.0:1790784365.505877:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359550464 00000100:00100000:0.0:1790784365.505932:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790784365.505941:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459102e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359550464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790784365.506585:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790784365.508757:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459102e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359550464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2808us (5123us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784365.508778:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1790784365.516608:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593f50ea00 x1877773359550464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790784365.516634:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359550464:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790784366.074633:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784367.099842:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784368.124127:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790784369.051779:0:9021:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg632-server.virtnet: executing yml_node 00000100:00100000:3.0:1790784369.074825:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784369.075071:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784369.076214:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344841216 00000100:00100000:0.0:1790784369.076226:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344841216 00000100:00100000:0.0:1790784369.076815:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 194 00000100:00100000:0.0:1790784369.076990:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:2352:x1877773344841216:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:0.0:1790784369.077064:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:2352:x1877773344841216:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 240us (2249us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784369.077073:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 194 00000100:00100000:1.0:1790784369.077683:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784369.077791:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784369.077843:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344841472 00000100:00100000:3.0:1790784369.077851:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344841472 00000100:00100000:3.0:1790784369.077897:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344841600 00000100:00100000:3.0:1790784369.077901:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344841600 00000100:00100000:3.0:1790784369.077920:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 10 00000100:00100000:3.0:1790784369.077927:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459102e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2348:x1877773344841472:12345-192.168.206.32@tcp:9:kworker.0 00000020:00000080:3.0:1790784369.077955:0:6668:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d3653 00000100:00080000:3.0:1790784369.077964:0:6668:0:(import.c:65:import_set_state_nolock()) ffff945907c61000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790784369.077998:0:6668:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1790784369.078300:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459102e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+2:2348:x1877773344841472:12345-192.168.206.32@tcp:9:kworker.0 Request processed in 363us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784369.078309:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 10 00000100:00100000:3.0:1790784369.078336:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 11 00000100:00100000:3.0:1790784369.078343:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459102e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2348:x1877773344841600:12345-192.168.206.32@tcp:9:kworker.0 00000020:00000080:3.0:1790784369.078356:0:6668:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d365a 00000100:00080000:3.0:1790784369.078362:0:6668:0:(import.c:65:import_set_state_nolock()) ffff945935df0000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790784369.078400:0:6668:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1790784369.078581:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459102e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+2:2348:x1877773344841600:12345-192.168.206.32@tcp:9:kworker.0 Request processed in 238us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784369.078588:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 11 00010000:00010000:3.0:1790784369.078654:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790784369.078878:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790784369.078882:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790784369.079046:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344841344 00000100:00100000:2.0:1790784369.079051:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344841344 00000100:00100000:2.0:1790784369.079100:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 36 00000100:00100000:2.0:1790784369.079107:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f50c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2352:x1877773344841344:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1790784369.079144:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f50c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2352:x1877773344841344:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 39us (4075us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784369.079151:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 36 00010000:00010000:2.0:1790784369.079190:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790784369.079232:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790784369.147750:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784370.108106:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359550592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790784370.108177:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784370.108618:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359550592 00000100:00100000:0.0:1790784370.108626:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359550592 00000100:00100000:0.0:1790784370.108681:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790784370.108693:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359550592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790784370.108725:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790784370.108766:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359550592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784370.108772:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1790784370.108790:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790784370.109181:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94592d1e0a80 x1877773359550592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790784370.109200:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359550592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790784370.110515:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359550720:0@lo:400:kworker.0 00000100:00100000:0.0:1790784370.110645:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784370.111490:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359550720 00000100:00100000:2.0:1790784370.111498:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359550720 00000100:00100000:2.0:1790784370.111547:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1790784370.111556:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3279:x1877773359550720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784370.114757:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3279:x1877773359550720:12345-0@lo:400:kworker.0 Request processed in 3194us (4103us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784370.114780:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1790784370.115132:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f50c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1877773359550848:0@lo:400:kworker.0 00000100:00100000:2.0:1790784370.115180:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784370.115217:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359550848 00000100:00100000:2.0:1790784370.115225:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359550848 00000100:00100000:2.0:1790784370.115274:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790784370.115283:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1877773359550848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784370.115351:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1877773359550848:12345-0@lo:400:kworker.0 Request processed in 70us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784370.115358:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790784370.115411:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f50c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1877773359550848:0@lo:400:kworker.0 00000100:00100000:3.0:1790784370.118076:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f50c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359550976:0@lo:400:kworker.0 00000100:00100000:3.0:1790784370.118132:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784370.118164:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790784370.118170:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1877773359551104:0@lo:400:kworker.0 00000100:00100000:3.0:1790784370.118193:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784370.118219:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359550976 00000100:00100000:3.0:1790784370.118226:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359550976 00000100:00100000:3.0:1790784370.118281:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359551104 00000100:00100000:3.0:1790784370.118292:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359551104 00000100:00100000:3.0:1790784370.118311:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790784370.118319:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f50f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1877773359550976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784370.118371:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f50f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1877773359550976:12345-0@lo:400:kworker.0 Request processed in 53us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784370.118394:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790784370.118409:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790784370.118415:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f50d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1877773359551104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784370.118441:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f50d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1877773359551104:12345-0@lo:400:kworker.0 Request processed in 26us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784370.118454:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1790784370.118473:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790784370.118502:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1877773359551104:0@lo:400:kworker.0 00000100:00100000:3.0:1790784370.118513:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f50c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359550976:0@lo:400:kworker.0 00000100:00100000:3.0:1790784370.118658:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790784370.118667:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f50e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359551232:0@lo:400:kworker.0 00000100:00100000:3.0:1790784370.118693:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784370.118717:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359551232 00000100:00100000:3.0:1790784370.118721:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359551232 00000100:00100000:3.0:1790784370.118749:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790784370.118756:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f50c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359551232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784370.118790:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f50c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359551232:12345-0@lo:400:kworker.0 Request processed in 35us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784370.118796:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1790784370.118813:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1790784370.118828:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593f50e680 x1877773359551232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784370.118855:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f50e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359551232:0@lo:400:kworker.0 00000100:00100000:0.0:1790784370.124312:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359550720:0@lo:400:kworker.0 00010000:00010000:0.0:1790784370.173437:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790784370.199336:0:6693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b0f9e8c2-ddb0-4027-babe-0b166585860c 00000020:00000080:3.0:1790784370.199345:0:6693:0:(genops.c:885:class_export_put()) final put ffff945907c62000/b0f9e8c2-ddb0-4027-babe-0b166585860c 00000020:00000080:3.0:1790784370.199371:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff945907c62000/b0f9e8c2-ddb0-4027-babe-0b166585860c for lustre-OST0000 00000020:00000080:3.0:1790784370.199428:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff945907c61000 for lustre-OST0000 00000100:00100000:3.0:1790784370.627275:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f50e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359551360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790784370.627346:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784370.629784:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359551360 00000100:00100000:0.0:1790784370.629797:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359551360 00000100:00100000:0.0:1790784370.629849:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790784370.629860:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f50ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359551360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790784370.629908:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790784370.629999:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f50ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359551360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (2652us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784370.630006:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1790784370.630053:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593f50e680 x1877773359551360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784370.630073:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f50e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359551360:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1790784370.726504:0:7614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b0f9e8c2-ddb0-4027-babe-0b166585860c 00000020:00000080:1.0:1790784370.726514:0:7614:0:(genops.c:885:class_export_put()) final put ffff945935df5800/b0f9e8c2-ddb0-4027-babe-0b166585860c 00000020:00000080:0.0:1790784370.726795:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff945935df5800/b0f9e8c2-ddb0-4027-babe-0b166585860c for lustre-OST0001 00000020:00000080:0.0:1790784370.726849:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff945935df0000 for lustre-OST0001 00010000:00010000:3.0:1790784371.194636:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784372.219419:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784373.242618:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784374.187831:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784374.187891:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784374.188072:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344841728 00000100:00100000:3.0:1790784374.188084:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344841728 00000100:00100000:3.0:1790784374.188153:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 196 00000100:00100000:3.0:1790784374.188165:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:2352:x1877773344841728:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1790784374.188275:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:2352:x1877773344841728:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 102us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784374.188283:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 196 00000100:00100000:0.0:1790784374.188685:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344841856 00000100:00100000:0.0:1790784374.188692:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344841856 00000100:00100000:0.0:1790784374.188753:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 40 00000100:00100000:0.0:1790784374.188763:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2352:x1877773344841856:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:0.0:1790784374.188815:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2352:x1877773344841856:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 55us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784374.188822:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 40 00000100:00080000:2.0:1790784374.189432:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790784374.273423:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790784374.467046:0:9214:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.40 00000100:00100000:0.0:1790784375.226757:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3280:1877773359551872:0@lo:400:kworker.0 00000100:00100000:0.0:1790784375.226828:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784375.226831:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459102e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359551488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790784375.226838:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1877773359551744:0@lo:400:kworker.0 00000100:00100000:3.0:1790784375.226872:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784375.226872:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784375.226957:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359552256:0@lo:400:kworker.0 00000100:00100000:3.0:1790784375.226962:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359552000:0@lo:400:kworker.0 00000100:00100000:1.0:1790784375.226981:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784375.226986:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359551616:0@lo:400:kworker.0 00000100:00100000:3.0:1790784375.227012:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784375.227014:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359551872 00000100:00100000:1.0:1790784375.227020:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359551872 00000100:00100000:3.0:1790784375.227032:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1877773359552128:0@lo:400:kworker.0 00000100:00100000:3.0:1790784375.227051:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784375.227062:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359551744 00000100:00100000:1.0:1790784375.227065:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359551744 00000100:00100000:3.0:1790784375.227075:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359552128 00000100:00100000:3.0:1790784375.227078:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359552128 00000100:00100000:1.0:1790784375.227080:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790784375.227087:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d1e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1877773359551872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784375.227094:0:5820:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1790784375.227100:0:5820:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1790784375.227115:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359551488 00000100:00100000:3.0:1790784375.227118:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359551488 00000100:00100000:1.0:1790784375.227134:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d1e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1877773359551872:12345-0@lo:400:kworker.0 Request processed in 47us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784375.227142:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790784375.227142:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790784375.227148:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f50d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359551488:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790784375.227156:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790784375.227160:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459102eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1877773359551744:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1790784375.227171:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790784375.227187:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459102eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1877773359551744:12345-0@lo:400:kworker.0 Request processed in 26us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784375.227192:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790784375.227202:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790784375.227215:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f50c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1877773359552128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784375.227244:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f50c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1877773359552128:12345-0@lo:400:kworker.0 Request processed in 30us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784375.227247:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f50d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359551488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784375.227250:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790784375.227275:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790784375.227284:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359552256 00000100:00100000:1.0:1790784375.227288:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359552256 00000100:00100000:3.0:1790784375.227291:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359551616 00000100:00100000:3.0:1790784375.227294:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359551616 00000100:00100000:1.0:1790784375.227312:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790784375.227320:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459102e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359552256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784375.227327:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1790784375.227333:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3282:x1877773359551616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784375.227350:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459102e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359552256:12345-0@lo:400:kworker.0 Request processed in 32us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784375.227356:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790784375.227358:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3282:x1877773359551616:12345-0@lo:400:kworker.0 Request processed in 26us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784375.227364:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:1.0:1790784375.227371:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790784375.227391:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790784375.227393:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790784375.227420:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3280:1877773359551872:0@lo:400:kworker.0 00000100:00100000:1.0:1790784375.227447:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1877773359551744:0@lo:400:kworker.0 00010000:00080000:1.0:1790784375.227458:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94592d1e0380 x1877773359552256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790784375.227467:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359552256:0@lo:400:kworker.0 00000100:00100000:3.0:1790784375.227691:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359551616:0@lo:400:kworker.0 00000100:00100000:3.0:1790784375.227701:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1877773359552128:0@lo:400:kworker.0 00000100:00100000:3.0:1790784375.227720:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1790784375.227751:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9459102e9500 x1877773359551488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784375.227766:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459102e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359551488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790784375.227785:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359552000 00000100:00100000:3.0:1790784375.227788:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359552000 00000100:00100000:3.0:1790784375.227809:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790784375.227814:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f50e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359552000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784375.227852:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f50e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359552000:12345-0@lo:400:kworker.0 Request processed in 37us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784375.227857:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1790784375.227879:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94592d1e0a80 x1877773359552000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784375.227900:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359552000:0@lo:400:kworker.0 00010000:00010000:3.0:1790784375.291741:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784375.739074:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359552384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790784375.739148:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784375.739301:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359552384 00000100:00100000:3.0:1790784375.739309:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359552384 00000100:00100000:3.0:1790784375.739355:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790784375.739364:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359552384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790784375.739412:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790784375.739455:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359552384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784375.739461:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1790784375.742312:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593f50fb80 x1877773359552384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784375.742340:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f50fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359552384:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790784376.314689:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784377.338683:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790784377.405361:0:9314:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.40 00010000:00010000:1.0:1790784378.365184:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784379.307663:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784379.307712:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784379.307970:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344841984 00000100:00100000:0.0:1790784379.307979:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344841984 00000100:00100000:0.0:1790784379.308031:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 198 00000100:00100000:0.0:1790784379.308041:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:2352:x1877773344841984:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:0.0:1790784379.308117:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:2352:x1877773344841984:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 78us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784379.308125:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 198 00000100:00100000:1.0:1790784379.308776:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344842112 00000100:00100000:1.0:1790784379.308781:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344842112 00000100:00100000:1.0:1790784379.308849:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 44 00000100:00100000:1.0:1790784379.308858:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2352:x1877773344842112:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784379.308921:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2352:x1877773344842112:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 64us (1207us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784379.308929:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 44 00000100:00080000:2.0:1790784379.309146:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790784379.387823:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784380.347962:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459102e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359552512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790784380.348022:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784380.348205:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359552512 00000100:00100000:1.0:1790784380.348213:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359552512 00000100:00080000:3.0:1790784380.348364:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790784380.348436:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790784380.348447:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f50fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359552512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790784380.348484:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790784380.348535:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f50fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359552512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784380.348542:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1790784380.348749:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9459102e9500 x1877773359552512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784380.348768:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459102e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359552512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790784380.349240:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1877773359553024:0@lo:400:kworker.0 00000100:00100000:3.0:1790784380.349302:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784380.349337:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790784380.349343:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359552640:0@lo:400:kworker.0 00000100:00100000:3.0:1790784380.349369:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784380.349420:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359553152:0@lo:400:kworker.0 00000100:00100000:3.0:1790784380.349443:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784380.350003:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359552640 00000100:00100000:3.0:1790784380.350010:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359552640 00000100:00100000:3.0:1790784380.350045:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1790784380.350053:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3281:x1877773359552640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784380.350270:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3281:x1877773359552640:12345-0@lo:400:kworker.0 Request processed in 216us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784380.350283:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1790784380.350314:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359553152 00000100:00100000:3.0:1790784380.350317:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359553152 00000100:00100000:3.0:1790784380.350356:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790784380.350363:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c3a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359553152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784380.350978:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1877773359552768:0@lo:400:kworker.0 00000100:00100000:1.0:1790784380.351010:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784380.351033:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790784380.351038:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359552896:0@lo:400:kworker.0 00000100:00100000:1.0:1790784380.351055:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784380.351076:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359553024 00000100:00100000:1.0:1790784380.351080:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359553024 00000100:00100000:1.0:1790784380.351104:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359552768 00000100:00100000:1.0:1790784380.351106:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359552768 00000100:00100000:1.0:1790784380.351115:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359552896 00000100:00100000:1.0:1790784380.351117:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359552896 00000100:00100000:1.0:1790784380.351127:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790784380.351132:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c3a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1877773359553024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784380.351160:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c3a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1877773359553024:12345-0@lo:400:kworker.0 Request processed in 28us (1858us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784380.351166:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790784380.351177:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790784380.351184:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459102ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1877773359552768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784380.351209:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459102ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1877773359552768:12345-0@lo:400:kworker.0 Request processed in 26us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784380.351215:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790784380.351244:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790784380.351250:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459102e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359552896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784380.351274:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459102e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359552896:12345-0@lo:400:kworker.0 Request processed in 25us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784380.351407:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c3a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359553152:12345-0@lo:400:kworker.0 Request processed in 1045us (1962us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784380.351415:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1790784380.351435:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790784380.351439:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790784380.351459:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359552640:0@lo:400:kworker.0 00010000:00080000:3.0:1790784380.351477:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94591aa54a80 x1877773359553152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784380.351487:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359553152:0@lo:400:kworker.0 00000100:00100000:1.0:1790784380.351767:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790784380.351796:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359552896:0@lo:400:kworker.0 00000100:00100000:1.0:1790784380.351804:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1877773359552768:0@lo:400:kworker.0 00000100:00100000:3.0:1790784380.351881:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1877773359553024:0@lo:400:kworker.0 00010000:00010000:1.0:1790784380.410590:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784380.859916:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790784380.859938:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c3a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359553280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790784380.860435:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784380.861625:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359553280 00000100:00100000:3.0:1790784380.861636:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359553280 00000100:00100000:3.0:1790784380.861700:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790784380.861710:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359553280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790784380.861744:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790784380.861808:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359553280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (1807us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784380.861815:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1790784380.863857:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593c3a2d80 x1877773359553280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784380.863882:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c3a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359553280:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1790784381.285361:0:9413:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.40 00010000:00010000:2.0:1790784381.435819:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784382.458591:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784383.482590:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790784383.745280:0:9461:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Sep 30 12:06:21 EDT 2026 00000100:00100000:2.0:1790784384.428532:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784384.428586:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784384.428701:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344842240 00000100:00100000:3.0:1790784384.428713:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344842240 00000100:00100000:3.0:1790784384.428795:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 200 00000100:00100000:3.0:1790784384.428807:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:2349:x1877773344842240:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1790784384.428889:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:2349:x1877773344842240:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 84us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784384.428896:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 200 00000100:00100000:0.0:1790784384.434613:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344842368 00000100:00100000:0.0:1790784384.434633:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344842368 00000100:00100000:0.0:1790784384.434831:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 48 00000100:00100000:0.0:1790784384.434845:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2349:x1877773344842368:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:0.0:1790784384.434963:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2349:x1877773344842368:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 122us (6375us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784384.434989:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 48 00000100:00080000:3.0:1790784384.439771:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790784384.507005:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784385.467983:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1877773359553536:0@lo:400:kworker.0 00000100:00100000:2.0:1790784385.468052:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784385.468100:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359554048:0@lo:400:kworker.0 00000100:00100000:2.0:1790784385.468143:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784385.468174:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790784385.468180:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359553664:0@lo:400:kworker.0 00000100:00100000:2.0:1790784385.468202:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784385.468318:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359553792:0@lo:400:kworker.0 00000100:00100000:1.0:1790784385.468348:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784385.468409:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1790784385.468414:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359553408:0@lo:400:kworker.0 00000100:00100000:1.0:1790784385.468599:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784385.468623:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1877773359553920:0@lo:400:kworker.0 00000100:00100000:1.0:1790784385.468647:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784385.468673:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359554048 00000100:00100000:1.0:1790784385.468681:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359554048 00000100:00100000:1.0:1790784385.468728:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359553792 00000100:00100000:1.0:1790784385.468732:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359553792 00000100:00100000:1.0:1790784385.468755:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790784385.468763:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359554048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784385.468815:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359554048:12345-0@lo:400:kworker.0 Request processed in 52us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784385.468821:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790784385.468846:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790784385.468852:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459102e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359553792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784385.468885:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459102e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359553792:12345-0@lo:400:kworker.0 Request processed in 34us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784385.468891:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1790784385.468907:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790784385.468911:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790784385.468939:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94591aa54e00 x1877773359553792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790784385.468952:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359553792:0@lo:400:kworker.0 00000100:00100000:2.0:1790784385.469049:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359553536 00000100:00100000:2.0:1790784385.469054:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359553536 00000100:00100000:2.0:1790784385.469085:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359553664 00000100:00100000:2.0:1790784385.469088:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359553664 00000100:00100000:2.0:1790784385.469109:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359553920 00000100:00100000:2.0:1790784385.469112:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359553920 00000100:00100000:2.0:1790784385.469126:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790784385.469133:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1877773359553536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784385.469165:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1877773359553536:12345-0@lo:400:kworker.0 Request processed in 33us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784385.469172:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790784385.469185:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790784385.469192:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1877773359553664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784385.469234:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1877773359553664:12345-0@lo:400:kworker.0 Request processed in 42us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784385.469249:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790784385.469261:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790784385.469267:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459102e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1877773359553920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784385.469300:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459102e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1877773359553920:12345-0@lo:400:kworker.0 Request processed in 33us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784385.469305:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1790784385.469324:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790784385.469340:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1877773359553920:0@lo:400:kworker.0 00000100:00100000:0.0:1790784385.469525:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359553408 00000100:00100000:0.0:1790784385.469530:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359553408 00000100:00100000:0.0:1790784385.469674:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1790784385.469682:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3279:x1877773359553408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784385.469731:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3279:x1877773359553408:12345-0@lo:400:kworker.0 Request processed in 50us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784385.469737:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1790784385.471844:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359553664:0@lo:400:kworker.0 00000100:00100000:1.0:1790784385.471862:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1877773359553536:0@lo:400:kworker.0 00010000:00080000:1.0:1790784385.471876:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94591aa57480 x1877773359554048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790784385.471887:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359554048:0@lo:400:kworker.0 00000100:00100000:2.0:1790784385.472006:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359553408:0@lo:400:kworker.0 00000100:00100000:1.0:1790784385.473856:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790784385.473873:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359554176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790784385.473930:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784385.473971:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359554176 00000100:00100000:1.0:1790784385.473977:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359554176 00000100:00100000:1.0:1790784385.474020:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790784385.474027:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359554176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790784385.474056:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790784385.474112:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359554176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784385.474125:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1790784385.474161:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593d7e5880 x1877773359554176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790784385.474179:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359554176:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790784385.533825:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784385.990747:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c3a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359554304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790784385.990812:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784385.990900:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359554304 00000100:00100000:3.0:1790784385.990906:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359554304 00000100:00100000:3.0:1790784385.990948:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790784385.990956:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c3a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359554304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790784385.990986:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790784385.991032:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c3a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359554304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784385.991040:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1790784385.991437:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593c3a2300 x1877773359554304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784385.991455:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c3a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359554304:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790784386.556333:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784387.581975:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784388.604615:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784389.550863:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784389.551016:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344842496 00000100:00100000:1.0:1790784389.551026:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344842496 00000100:00100000:1.0:1790784389.551131:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 202 00000100:00100000:1.0:1790784389.551142:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:2352:x1877773344842496:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784389.551229:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:2352:x1877773344842496:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 89us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784389.551237:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 202 00000100:00100000:2.0:1790784389.560828:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784389.560925:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344842624 00000100:00100000:1.0:1790784389.560935:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344842624 00000100:00100000:1.0:1790784389.561050:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 52 00000100:00100000:1.0:1790784389.561061:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2352:x1877773344842624:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784389.561141:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2352:x1877773344842624:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 82us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784389.561149:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 52 00000100:00080000:2.0:1790784389.563582:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790784389.629590:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784390.589511:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359554432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790784390.589607:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784390.589910:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359554432 00000100:00100000:3.0:1790784390.589918:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359554432 00000100:00100000:3.0:1790784390.589985:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790784390.589994:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c3a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359554432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790784390.590026:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790784390.590068:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c3a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359554432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784390.590075:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1790784390.590670:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790784390.597534:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359554560:0@lo:400:kworker.0 00000100:00100000:2.0:1790784390.597612:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784390.597804:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359555072:0@lo:400:kworker.0 00000100:00100000:2.0:1790784390.597834:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784390.597871:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790784390.597878:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1877773359554688:0@lo:400:kworker.0 00000100:00100000:2.0:1790784390.597903:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784390.597933:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359555072 00000100:00100000:2.0:1790784390.597939:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359555072 00000100:00100000:2.0:1790784390.597988:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790784390.597997:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359555072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784390.598047:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359555072:12345-0@lo:400:kworker.0 Request processed in 51us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784390.598054:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1790784390.598077:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790784390.598101:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94591aa54e00 x1877773359555072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790784390.598115:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359555072:0@lo:400:kworker.0 00000100:00100000:0.0:1790784390.598501:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359554560 00000100:00100000:0.0:1790784390.598507:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359554560 00000100:00100000:0.0:1790784390.598543:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1790784390.598549:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3281:x1877773359554560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784390.599129:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3281:x1877773359554560:12345-0@lo:400:kworker.0 Request processed in 578us (1515us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784390.599138:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1790784390.599168:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359554688 00000100:00100000:0.0:1790784390.599172:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359554688 00000100:00100000:0.0:1790784390.599216:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790784390.599223:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1877773359554688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784390.599252:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1877773359554688:12345-0@lo:400:kworker.0 Request processed in 30us (1348us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784390.599258:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790784390.600156:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359554816:0@lo:400:kworker.0 00000100:00100000:0.0:1790784390.600211:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784390.600245:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790784390.600252:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1877773359554944:0@lo:400:kworker.0 00000100:00100000:0.0:1790784390.600286:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784390.600317:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359554816 00000100:00100000:0.0:1790784390.600322:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359554816 00000100:00100000:2.0:1790784390.600545:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1877773359554688:0@lo:400:kworker.0 00000100:00100000:2.0:1790784390.600555:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359554560:0@lo:400:kworker.0 00000100:00100000:0.0:1790784390.603302:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359554944 00000100:00100000:0.0:1790784390.603314:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359554944 00000100:00100000:0.0:1790784390.603508:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790784390.603565:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359554816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784390.603717:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359554816:12345-0@lo:400:kworker.0 Request processed in 155us (3505us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784390.603725:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790784390.603741:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790784390.603748:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1877773359554944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784390.603777:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1877773359554944:12345-0@lo:400:kworker.0 Request processed in 29us (3490us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784390.603782:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790784390.603823:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1877773359554944:0@lo:400:kworker.0 00000100:00100000:0.0:1790784390.603835:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359554816:0@lo:400:kworker.0 00000100:00080000:0.0:1790784390.604109:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790784390.606778:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593d7e5880 x1877773359554432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784390.606799:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359554432:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790784390.656264:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784391.113891:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359555200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790784391.113958:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784391.114049:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359555200 00000100:00100000:0.0:1790784391.114057:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359555200 00000100:00100000:0.0:1790784391.114111:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790784391.114120:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c3a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359555200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790784391.114155:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790784391.122122:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c3a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359555200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7993us (8153us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784391.122150:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1790784391.125890:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593d7e5180 x1877773359555200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784391.125916:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359555200:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790784391.676203:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784392.723110:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784393.734823:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784394.669183:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784394.669308:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784394.669558:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344842880 00000100:00100000:3.0:1790784394.669571:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344842880 00000100:00100000:3.0:1790784394.669656:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 56 00000100:00100000:3.0:1790784394.669667:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2349:x1877773344842880:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1790784394.669756:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2349:x1877773344842880:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 91us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784394.669764:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 56 00000100:00080000:2.0:1790784394.670359:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790784394.675863:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344842752 00000100:00100000:1.0:1790784394.675881:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344842752 00000100:00100000:1.0:1790784394.675955:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 204 00000100:00100000:1.0:1790784394.675966:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:2349:x1877773344842752:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784394.676072:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:2349:x1877773344842752:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 108us (6901us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784394.676080:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 204 00010000:00010000:1.0:1790784394.748193:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784395.706862:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359555328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790784395.706918:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784395.706981:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359555328 00000100:00100000:2.0:1790784395.706988:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359555328 00000100:00100000:2.0:1790784395.707035:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790784395.707043:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359555328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790784395.707070:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790784395.707106:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359555328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784395.707112:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1790784395.707129:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790784395.707163:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94592d223800 x1877773359555328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790784395.707180:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d223800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359555328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790784395.710071:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1877773359555584:0@lo:400:kworker.0 00000100:00100000:0.0:1790784395.710124:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784395.710168:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790784395.710175:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359555712:0@lo:400:kworker.0 00000100:00100000:0.0:1790784395.710203:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784395.710233:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359555584 00000100:00100000:0.0:1790784395.710239:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359555584 00000100:00100000:0.0:1790784395.710276:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359555712 00000100:00100000:0.0:1790784395.710279:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359555712 00000100:00100000:0.0:1790784395.710307:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790784395.710315:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d1e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1877773359555584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784395.710359:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d1e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1877773359555584:12345-0@lo:400:kworker.0 Request processed in 45us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784395.710365:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790784395.710859:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790784395.710869:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1877773359555712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784395.710906:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1877773359555712:12345-0@lo:400:kworker.0 Request processed in 40us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784395.710912:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790784395.710935:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3280:1877773359555456:0@lo:400:kworker.0 00000100:00100000:2.0:1790784395.710965:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784395.711001:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359555968:0@lo:400:kworker.0 00000100:00100000:2.0:1790784395.711027:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784395.711048:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790784395.711054:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3280:1877773359555840:0@lo:400:kworker.0 00000100:00100000:2.0:1790784395.711075:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784395.711100:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359555456 00000100:00100000:2.0:1790784395.711104:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359555456 00000100:00100000:2.0:1790784395.711133:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1790784395.711141:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3280:x1877773359555456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784395.711219:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3280:x1877773359555456:12345-0@lo:400:kworker.0 Request processed in 79us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784395.711226:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1790784395.711252:0:8181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359555968 00000100:00100000:2.0:1790784395.711256:0:8181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359555968 00000100:00100000:2.0:1790784395.711281:0:8181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790784395.711287:0:8181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359555968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784395.711316:0:8181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359555968:12345-0@lo:400:kworker.0 Request processed in 29us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784395.711322:0:8181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1790784395.711343:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790784395.711347:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790784395.711363:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359555840 00000100:00100000:2.0:1790784395.711366:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359555840 00000100:00100000:2.0:1790784395.711414:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790784395.711420:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1877773359555840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784395.711449:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1877773359555840:12345-0@lo:400:kworker.0 Request processed in 29us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784395.711464:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1790784395.711479:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790784395.711501:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3280:1877773359555840:0@lo:400:kworker.0 00000100:00100000:2.0:1790784395.711510:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3280:1877773359555456:0@lo:400:kworker.0 00010000:00080000:2.0:1790784395.711519:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94592d1e0380 x1877773359555968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790784395.711528:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359555968:0@lo:400:kworker.0 00000100:00100000:0.0:1790784395.711723:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359555712:0@lo:400:kworker.0 00000100:00100000:0.0:1790784395.711803:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1877773359555584:0@lo:400:kworker.0 00010000:00010000:2.0:1790784395.770633:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784396.223989:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790784396.224011:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d220e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359556096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790784396.224071:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784396.224140:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359556096 00000100:00100000:0.0:1790784396.224147:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359556096 00000100:00100000:0.0:1790784396.224200:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790784396.224209:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d1e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359556096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790784396.224240:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790784396.224282:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d1e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359556096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784396.224303:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1790784396.224341:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94592d220e00 x1877773359556096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784396.224358:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d220e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359556096:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790784396.794567:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784397.821252:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784398.844342:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784399.790070:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784399.790182:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344843008 00000100:00100000:0.0:1790784399.790196:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344843008 00000100:00100000:0.0:1790784399.790271:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 206 00000100:00100000:0.0:1790784399.790281:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:2349:x1877773344843008:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:0.0:1790784399.790364:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:2349:x1877773344843008:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 85us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784399.790398:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 206 00000100:00100000:2.0:1790784399.790513:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784399.790544:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344843136 00000100:00100000:2.0:1790784399.790549:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344843136 00000100:00100000:2.0:1790784399.791098:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 60 00000100:00100000:2.0:1790784399.791113:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2349:x1877773344843136:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1790784399.791194:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2349:x1877773344843136:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 86us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784399.791202:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 60 00000100:00080000:0.0:1790784399.792431:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790784399.868061:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784400.826914:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359556224:0@lo:400:kworker.0 00000100:00100000:0.0:1790784400.827013:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784400.827071:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1877773359556736:0@lo:400:kworker.0 00000100:00100000:0.0:1790784400.827117:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784400.827167:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790784400.827174:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359556608:0@lo:400:kworker.0 00000100:00100000:0.0:1790784400.827202:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784400.827237:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1877773359556352:0@lo:400:kworker.0 00000100:00100000:0.0:1790784400.827263:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784400.827281:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359556864:0@lo:400:kworker.0 00000100:00100000:0.0:1790784400.827306:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784400.827326:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790784400.827341:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359556480:0@lo:400:kworker.0 00000100:00100000:0.0:1790784400.827366:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784400.827430:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359556224 00000100:00100000:0.0:1790784400.827439:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359556224 00000100:00100000:0.0:1790784400.827495:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1790784400.827506:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3282:x1877773359556224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784400.827562:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3282:x1877773359556224:12345-0@lo:400:kworker.0 Request processed in 58us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784400.827570:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1790784400.827609:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359556736 00000100:00100000:0.0:1790784400.827613:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359556736 00000100:00100000:0.0:1790784400.827650:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359556352 00000100:00100000:0.0:1790784400.827654:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359556352 00000100:00100000:0.0:1790784400.827666:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359556480 00000100:00100000:0.0:1790784400.827668:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359556480 00000100:00100000:0.0:1790784400.827683:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790784400.827690:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592dacb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1877773359556736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784400.827724:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592dacb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1877773359556736:12345-0@lo:400:kworker.0 Request processed in 35us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784400.827731:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790784400.827745:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790784400.827751:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592dac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1877773359556352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784400.827783:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592dac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1877773359556352:12345-0@lo:400:kworker.0 Request processed in 33us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784400.827789:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790784400.827802:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790784400.827808:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592dac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359556480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784400.827848:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592dac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359556480:12345-0@lo:400:kworker.0 Request processed in 40us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784400.827854:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790784400.827874:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359556608 00000100:00100000:0.0:1790784400.827878:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359556608 00000100:00100000:0.0:1790784400.827906:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359556864 00000100:00100000:0.0:1790784400.827909:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359556864 00000100:00100000:0.0:1790784400.827930:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790784400.827937:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592dac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359556608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784400.827967:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592dac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359556608:12345-0@lo:400:kworker.0 Request processed in 31us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784400.827973:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790784400.827984:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790784400.827991:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592dac9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359556864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784400.828018:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592dac9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359556864:12345-0@lo:400:kworker.0 Request processed in 28us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784400.828023:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1790784400.828057:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790784400.828062:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790784400.828065:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790784400.828106:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359556480:0@lo:400:kworker.0 00000100:00100000:0.0:1790784400.828119:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1877773359556352:0@lo:400:kworker.0 00010000:00080000:0.0:1790784400.828145:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593c29c000 x1877773359556864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784400.828156:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359556864:0@lo:400:kworker.0 00010000:00080000:0.0:1790784400.828213:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94592d1e2680 x1877773359556608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784400.828221:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359556608:0@lo:400:kworker.0 00000100:00100000:0.0:1790784400.828229:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359556224:0@lo:400:kworker.0 00000100:00100000:0.0:1790784400.828238:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1877773359556736:0@lo:400:kworker.0 00000100:00100000:0.0:1790784400.831865:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592dac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359556992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790784400.831948:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784400.832013:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359556992 00000100:00100000:0.0:1790784400.832022:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359556992 00000100:00100000:0.0:1790784400.832092:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790784400.832102:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592dac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359556992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790784400.832154:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790784400.832204:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592dac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359556992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784400.832211:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1790784400.832259:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94592dac9180 x1877773359556992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784400.832280:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592dac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359556992:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790784400.894136:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784401.339683:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359557120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790784401.339781:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784401.339932:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359557120 00000100:00100000:2.0:1790784401.339943:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359557120 00000100:00100000:2.0:1790784401.340007:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790784401.340019:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592dac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359557120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790784401.340061:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790784401.340113:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592dac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359557120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784401.340151:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1790784401.341212:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94592d223100 x1877773359557120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784401.341242:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359557120:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790784401.915247:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790784402.783315:0:10091:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 12:06:41 (1790784401) === 00010000:00010000:2.0:1790784402.938671:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784403.595818:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784403.595905:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344843264 00000100:00100000:1.0:1790784403.595914:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344843264 00000100:00100000:1.0:1790784403.595962:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 208 00000100:00100000:1.0:1790784403.595971:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:8124:x1877773344843264:12345-192.168.206.32@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790784403.595985:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784403.596001:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94590955ec00/0x2c3a1e2a079d371e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x394e0d8838134f0a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784403.596026:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94590955ec00/0x2c3a1e2a079d371e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f0a expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784403.596038:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94590955ec00/0x2c3a1e2a079d371e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f0a expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784403.596047:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94590955ec00, rc 0) 00000100:00100000:1.0:1790784403.596101:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+11:8124:x1877773344843264:12345-192.168.206.32@tcp:101:mount.lustre.0 Request processed in 130us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784403.596129:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 208 00000100:00100000:1.0:1790784403.599812:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784403.599910:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344843392 00000100:00100000:0.0:1790784403.599919:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344843392 00000100:00100000:0.0:1790784403.599973:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 209 00000100:00100000:0.0:1790784403.599983:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+11:8124:x1877773344843392:12345-192.168.206.32@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790784403.600345:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+11:8124:x1877773344843392:12345-192.168.206.32@tcp:501:mount.lustre.0 Request processed in 362us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784403.600354:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 209 00000100:00100000:3.0:1790784403.603519:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784403.604327:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344843520 00000100:00100000:0.0:1790784403.604336:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344843520 00000100:00100000:0.0:1790784403.604428:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 210 00000100:00100000:0.0:1790784403.604438:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+11:8124:x1877773344843520:12345-192.168.206.32@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790784403.604706:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+11:8124:x1877773344843520:12345-192.168.206.32@tcp:503:mount.lustre.0 Request processed in 269us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784403.604714:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 210 00000100:00100000:2.0:1790784403.610845:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784403.611099:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344843648 00000100:00100000:0.0:1790784403.611124:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344843648 00000100:00100000:0.0:1790784403.611193:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 211 00000100:00100000:0.0:1790784403.611203:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+11:8128:x1877773344843648:12345-192.168.206.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790784403.611547:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+11:8128:x1877773344843648:12345-192.168.206.32@tcp:502:llog_process_th.0 Request processed in 344us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784403.611555:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 211 00000100:00100000:1.0:1790784403.634758:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784403.635339:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344843776 00000100:00100000:0.0:1790784403.635349:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344843776 00000100:00100000:0.0:1790784403.635544:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 212 00000100:00100000:0.0:1790784403.635568:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+11:8128:x1877773344843776:12345-192.168.206.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790784403.636187:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+11:8128:x1877773344843776:12345-192.168.206.32@tcp:502:llog_process_th.0 Request processed in 619us (1435us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784403.636196:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 212 00000100:00100000:3.0:1790784403.640126:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784403.641074:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344843904 00000100:00100000:1.0:1790784403.641087:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344843904 00000100:00100000:1.0:1790784403.641219:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 213 00000100:00100000:1.0:1790784403.641230:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+11:8124:x1877773344843904:12345-192.168.206.32@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790784403.641245:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784403.641265:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94590955ea00/0x2c3a1e2a079d3725 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x394e0d8838134f34 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784403.641292:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94590955ea00/0x2c3a1e2a079d3725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f34 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784403.641304:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94590955ea00/0x2c3a1e2a079d3725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f34 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784403.641312:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94590955ea00, rc 0) 00000100:00100000:1.0:1790784403.641454:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+12:8124:x1877773344843904:12345-192.168.206.32@tcp:101:mount.lustre.0 Request processed in 226us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784403.641461:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 213 00000100:00100000:1.0:1790784403.649803:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784403.649913:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344844032 00000100:00100000:0.0:1790784403.649922:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344844032 00000100:00100000:0.0:1790784403.649976:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 214 00000100:00100000:0.0:1790784403.649986:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+12:8124:x1877773344844032:12345-192.168.206.32@tcp:256:mount.lustre.0 20000000:01000000:0.0:1790784403.650009:0:5812:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1790784403.650031:0:5812:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790784403.650046:0:5812:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1790784403.650049:0:5812:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1790784403.650051:0:5812:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1790784403.655348:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+12:8124:x1877773344844032:12345-192.168.206.32@tcp:256:mount.lustre.0 Request processed in 5353us (5545us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784403.655362:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 214 00000100:00100000:3.0:1790784403.657985:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784403.658099:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344844160 00000100:00100000:2.0:1790784403.658123:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344844160 00000100:00100000:2.0:1790784403.658202:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 215 00000100:00100000:2.0:1790784403.658214:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+12:8124:x1877773344844160:12345-192.168.206.32@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790784403.658236:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784403.658259:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94593fe74600/0x2c3a1e2a079d372c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x394e0d8838134f3b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784403.658294:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94593fe74600/0x2c3a1e2a079d372c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f3b expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784403.658308:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94593fe74600/0x2c3a1e2a079d372c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f3b expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784403.658320:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74600, rc 0) 00000100:00100000:2.0:1790784403.658436:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:8124:x1877773344844160:12345-192.168.206.32@tcp:101:mount.lustre.0 Request processed in 223us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784403.658443:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 215 00000100:00100000:1.0:1790784403.660930:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784403.662281:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344844288 00000100:00100000:2.0:1790784403.662317:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344844288 00000100:00100000:2.0:1790784403.663354:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 216 00000100:00100000:2.0:1790784403.663385:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:8124:x1877773344844288:12345-192.168.206.32@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790784403.664363:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:8124:x1877773344844288:12345-192.168.206.32@tcp:501:mount.lustre.0 Request processed in 990us (3439us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784403.664418:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 216 00000100:00100000:0.0:1790784403.666411:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784403.666515:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344844416 00000100:00100000:2.0:1790784403.666526:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344844416 00000100:00100000:2.0:1790784403.666592:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 217 00000100:00100000:2.0:1790784403.666605:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:8124:x1877773344844416:12345-192.168.206.32@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790784403.666906:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:8124:x1877773344844416:12345-192.168.206.32@tcp:503:mount.lustre.0 Request processed in 302us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784403.666924:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 217 00000100:00100000:3.0:1790784403.670971:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784403.671429:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344844544 00000100:00100000:2.0:1790784403.671443:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344844544 00000100:00100000:2.0:1790784403.671513:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 218 00000100:00100000:2.0:1790784403.671525:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:8132:x1877773344844544:12345-192.168.206.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790784403.671814:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:8132:x1877773344844544:12345-192.168.206.32@tcp:502:llog_process_th.0 Request processed in 291us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784403.671823:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 218 00000100:00100000:3.0:1790784403.679092:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784403.679176:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344844672 00000100:00100000:2.0:1790784403.679189:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344844672 00000100:00100000:2.0:1790784403.679265:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 219 00000100:00100000:2.0:1790784403.679277:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:8132:x1877773344844672:12345-192.168.206.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790784403.679712:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:8132:x1877773344844672:12345-192.168.206.32@tcp:502:llog_process_th.0 Request processed in 434us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784403.679729:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 219 00000100:00100000:0.0:1790784403.689100:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784403.689168:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784403.689570:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344844800 00000100:00100000:1.0:1790784403.689583:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344844800 00000100:00100000:1.0:1790784403.689671:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344845184 00000100:00100000:1.0:1790784403.689685:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344845184 00000100:00100000:2.0:1790784403.689712:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 10 00000100:00100000:2.0:1790784403.689723:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592daca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2348:x1877773344844800:12345-192.168.206.32@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790784403.689764:0:5820:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8@192.168.206.32@tcp t0 exp 0000000000000000 cur 237 last 0 00000100:00100000:1.0:1790784403.689766:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 64 00000100:00100000:1.0:1790784403.689774:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592dacb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2352:x1877773344845184:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784403.689859:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592dacb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2352:x1877773344845184:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 86us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784403.689866:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 64 00000020:00000080:2.0:1790784403.690276:0:5820:0:(genops.c:1384:class_connect()) connect: client 65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8, cookie 0x2c3a1e2a079d3733 00000004:00100000:2.0:1790784403.690545:0:5820:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790784403.690852:0:5820:0:(import.c:65:import_set_state_nolock()) ffff94590504d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790784403.691142:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592daca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+6:2348:x1877773344844800:12345-192.168.206.32@tcp:38:mount.lustre.0 Request processed in 1417us (2053us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784403.691152:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 10 00000100:00080000:3.0:1790784403.692187:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790784403.702646:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784403.702702:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784403.702836:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344845056 00000100:00100000:2.0:1790784403.702848:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344845056 00000100:00100000:2.0:1790784403.702967:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344844928 00000100:00100000:2.0:1790784403.702971:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344844928 00000100:00100000:2.0:1790784403.703000:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 11 00000100:00100000:2.0:1790784403.703011:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592dacad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+7:8124:x1877773344845056:12345-192.168.206.32@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790784403.703066:0:5819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790784403.703342:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592dacad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+7:8124:x1877773344845056:12345-192.168.206.32@tcp:41:mount.lustre.0 Request processed in 323us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784403.703354:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 11 00000100:00080000:3.0:1790784403.703368:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790784403.703429:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 12 00000100:00100000:2.0:1790784403.703443:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592daca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+6:0:x1877773344844928:12345-192.168.206.32@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790784403.703471:0:5819:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790784403.703497:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592daca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+6:0:x1877773344844928:12345-192.168.206.32@tcp:41:mount.lustre.0 Request processed in 60us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784403.703517:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 12 00000100:00100000:1.0:1790784403.707480:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784403.712045:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344845312 00000100:00100000:0.0:1790784403.712060:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344845312 00000100:00100000:0.0:1790784403.712187:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 13 00000100:00100000:0.0:1790784403.712198:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+6:8124:x1877773344845312:12345-192.168.206.32@tcp:40:mount.lustre.0 00000100:00100000:0.0:1790784403.712422:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+6:8124:x1877773344845312:12345-192.168.206.32@tcp:40:mount.lustre.0 Request processed in 225us (4950us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784403.712429:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 13 00000100:00100000:1.0:1790784403.714743:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784403.715447:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344845440 00000100:00100000:0.0:1790784403.715485:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344845440 00000100:00100000:0.0:1790784403.715732:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 12 00000100:00100000:0.0:1790784403.715741:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1877773344845440:12345-192.168.206.32@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790784403.715773:0:6669:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8@192.168.206.32@tcp t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:0.0:1790784403.715823:0:6669:0:(genops.c:1384:class_connect()) connect: client 65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8, cookie 0x2c3a1e2a079d373a 00002000:00100000:0.0:1790784403.715835:0:6669:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8/ffff94592da6d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790784403.715857:0:6669:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790784403.716805:0:6669:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790784403.716841:0:6669:0:(import.c:65:import_set_state_nolock()) ffff94592da6a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790784403.716914:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+6:2348:x1877773344845440:12345-192.168.206.32@tcp:8:mount.lustre.0 Request processed in 1172us (2182us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784403.716923:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 12 00000100:00100000:1.0:1790784403.716952:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784403.716984:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344845696 00000100:00100000:0.0:1790784403.716989:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344845696 00000100:00100000:0.0:1790784403.717028:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 1 00000100:00100000:0.0:1790784403.717040:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+6:8124:x1877773344845696:12345-192.168.206.32@tcp:33:mount.lustre.0 00000004:00200000:0.0:1790784403.717095:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1790784403.717144:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+6:8124:x1877773344845696:12345-192.168.206.32@tcp:33:mount.lustre.0 Request processed in 110us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784403.717151:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 1 00000100:00100000:1.0:1790784403.717279:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784403.719099:0:8181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344845568 00000100:00100000:0.0:1790784403.719122:0:8181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344845568 00000100:00100000:0.0:1790784403.719174:0:8181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 13 00000100:00100000:0.0:1790784403.719180:0:8181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1877773344845568:12345-192.168.206.32@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790784403.719209:0:8181:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8@192.168.206.32@tcp t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:0.0:1790784403.719330:0:8181:0:(genops.c:1384:class_connect()) connect: client 65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8, cookie 0x2c3a1e2a079d3741 00002000:00100000:0.0:1790784403.719341:0:8181:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8/ffff94592da6c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790784403.720047:0:8181:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790784403.721143:0:8181:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790784403.721184:0:8181:0:(import.c:65:import_set_state_nolock()) ffff94592da69000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790784403.721265:0:8181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+6:2348:x1877773344845568:12345-192.168.206.32@tcp:8:mount.lustre.0 Request processed in 2082us (3985us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784403.721275:0:8181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 13 00010000:00010000:2.0:1790784403.962652:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784404.989534:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784405.950575:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c3a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359557248:0@lo:400:kworker.0 00000100:00100000:0.0:1790784405.950653:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784405.950712:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c3a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1877773359557760:0@lo:400:kworker.0 00000100:00100000:0.0:1790784405.950738:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784405.950765:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790784405.950771:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c3a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359557632:0@lo:400:kworker.0 00000100:00100000:0.0:1790784405.950794:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784405.950824:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c3a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1877773359557376:0@lo:400:kworker.0 00000100:00100000:0.0:1790784405.950847:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784405.950865:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c3a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359557888:0@lo:400:kworker.0 00000100:00100000:0.0:1790784405.950888:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784405.950905:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790784405.950911:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c3a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359557504:0@lo:400:kworker.0 00000100:00100000:0.0:1790784405.950947:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784405.950979:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359557760 00000100:00100000:0.0:1790784405.950986:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359557760 00000100:00100000:0.0:1790784405.951035:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359557376 00000100:00100000:0.0:1790784405.951051:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359557376 00000100:00100000:0.0:1790784405.951069:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359557504 00000100:00100000:0.0:1790784405.951071:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359557504 00000100:00100000:0.0:1790784405.951085:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790784405.951092:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592dacb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1877773359557760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784405.951153:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592dacb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1877773359557760:12345-0@lo:400:kworker.0 Request processed in 61us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784405.951160:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790784405.951176:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790784405.951182:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592dacaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1877773359557376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784405.951213:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592dacaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1877773359557376:12345-0@lo:400:kworker.0 Request processed in 32us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784405.951219:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790784405.951230:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790784405.951235:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592dacbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359557504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784405.951260:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592dacbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359557504:12345-0@lo:400:kworker.0 Request processed in 25us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784405.951264:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790784405.951283:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359557632 00000100:00100000:0.0:1790784405.951287:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359557632 00000100:00100000:0.0:1790784405.951313:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359557888 00000100:00100000:0.0:1790784405.951315:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359557888 00000100:00100000:0.0:1790784405.951331:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790784405.951337:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592dac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359557632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784405.951366:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592dac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359557632:12345-0@lo:400:kworker.0 Request processed in 29us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784405.951372:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790784405.951416:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790784405.951421:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592dac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359557888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784405.951448:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592dac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359557888:12345-0@lo:400:kworker.0 Request processed in 27us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784405.951646:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359557248 00000100:00100000:3.0:1790784405.951651:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359557248 00000100:00100000:3.0:1790784405.951692:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1790784405.951700:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3282:x1877773359557248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784405.951736:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3282:x1877773359557248:12345-0@lo:400:kworker.0 Request processed in 37us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784405.951742:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1790784405.952725:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1790784405.952788:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790784405.952793:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790784405.952796:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790784405.952948:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359558016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790784405.952993:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784405.953057:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c3a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359557504:0@lo:400:kworker.0 00000100:00100000:0.0:1790784405.953070:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c3a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1877773359557376:0@lo:400:kworker.0 00010000:00080000:0.0:1790784405.953082:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593c3a3100 x1877773359557888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784405.953092:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c3a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359557888:0@lo:400:kworker.0 00010000:00080000:0.0:1790784405.953140:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593c3a0000 x1877773359557632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784405.953149:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c3a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359557632:0@lo:400:kworker.0 00000100:00100000:0.0:1790784405.953158:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c3a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359557248:0@lo:400:kworker.0 00000100:00100000:0.0:1790784405.953167:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c3a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1877773359557760:0@lo:400:kworker.0 00000100:00100000:3.0:1790784405.953262:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359558016 00000100:00100000:3.0:1790784405.953268:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359558016 00000100:00100000:3.0:1790784405.953320:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790784405.953328:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592dac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359558016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790784405.953361:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790784405.953433:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592dac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359558016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784405.953439:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1790784405.953578:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593d7e6300 x1877773359558016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790784405.953607:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359558016:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790784406.011631:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790784406.075089:0:6693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8 00000100:00100000:0.0:1790784406.462273:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c3a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359558144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790784406.462364:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784406.462452:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359558144 00000100:00100000:0.0:1790784406.462459:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359558144 00000100:00100000:0.0:1790784406.462613:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790784406.462633:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592dac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359558144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790784406.462666:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790784406.462710:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592dac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359558144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784406.462717:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1790784406.462758:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593c3a1c00 x1877773359558144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784406.462778:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c3a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359558144:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1790784406.526194:0:5841:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8 00000001:00100000:3.0:1790784406.529855:0:7614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8 00010000:00010000:1.0:1790784407.034709:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784408.059805:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790784409.004998:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784409.005046:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784409.005077:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784409.005107:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784409.005130:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784409.005153:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344846080 00000100:00100000:1.0:1790784409.005162:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344846080 00000100:00100000:1.0:1790784409.005212:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344845952 00000100:00100000:1.0:1790784409.005215:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344845952 00000100:00100000:1.0:1790784409.005237:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 68 00000100:00100000:1.0:1790784409.005246:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2349:x1877773344846080:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784409.005336:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2349:x1877773344846080:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 91us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784409.005344:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 68 00000100:00100000:1.0:1790784409.005361:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 69 00000100:00100000:1.0:1790784409.005367:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2349:x1877773344845952:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:0.0:1790784409.005681:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344845824 00000100:00100000:0.0:1790784409.005687:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344845824 00000100:00100000:0.0:1790784409.005722:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 221 00000100:00100000:0.0:1790784409.005729:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2349:x1877773344845824:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:0.0:1790784409.005766:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2349:x1877773344845824:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 37us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784409.005772:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 221 00000100:00100000:0.0:1790784409.005799:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344846336 00000100:00100000:0.0:1790784409.005803:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344846336 00000100:00100000:0.0:1790784409.005826:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344846208 00000100:00100000:0.0:1790784409.005829:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344846208 00000100:00100000:0.0:1790784409.005849:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 31 00000100:00100000:0.0:1790784409.005856:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2349:x1877773344846336:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:0.0:1790784409.005882:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2349:x1877773344846336:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 26us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784409.005888:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 31 00000100:00100000:0.0:1790784409.005909:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 32 00000100:00100000:0.0:1790784409.005916:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2349:x1877773344846208:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:0.0:1790784409.005942:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2349:x1877773344846208:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 27us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784409.005948:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 32 00000100:00100000:1.0:1790784409.006301:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2349:x1877773344845952:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 931us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784409.006309:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 69 00000100:00080000:1.0:1790784409.006345:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790784409.006349:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790784409.006351:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790784409.084679:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790784409.383863:0:10288:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg632-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1790784410.106635:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784411.066818:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359558656:0@lo:400:kworker.0 00000100:00100000:0.0:1790784411.066894:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784411.066942:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790784411.066948:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359558272:0@lo:400:kworker.0 00000100:00100000:0.0:1790784411.066972:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784411.066991:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1877773359558784:0@lo:400:kworker.0 00000100:00100000:0.0:1790784411.067009:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784411.067030:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1877773359558400:0@lo:400:kworker.0 00000100:00100000:0.0:1790784411.067050:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784411.067067:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359558912:0@lo:400:kworker.0 00000100:00100000:0.0:1790784411.067099:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784411.067116:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790784411.067122:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359558528:0@lo:400:kworker.0 00000100:00100000:0.0:1790784411.067142:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784411.067169:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359558656 00000100:00100000:0.0:1790784411.067175:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359558656 00000100:00100000:0.0:1790784411.067214:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359558912 00000100:00100000:0.0:1790784411.067217:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359558912 00000100:00100000:0.0:1790784411.067234:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790784411.067241:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359558656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784411.067310:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359558656:12345-0@lo:400:kworker.0 Request processed in 69us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784411.067317:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790784411.067331:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790784411.067337:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359558912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784411.067359:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359558912:12345-0@lo:400:kworker.0 Request processed in 23us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784411.067364:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790784411.067414:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359558272 00000100:00100000:0.0:1790784411.067417:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359558272 00000100:00100000:0.0:1790784411.067557:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1790784411.067563:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3281:x1877773359558272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784411.067590:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3281:x1877773359558272:12345-0@lo:400:kworker.0 Request processed in 27us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784411.067596:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1790784411.067629:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359558784 00000100:00100000:0.0:1790784411.067633:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359558784 00000100:00100000:0.0:1790784411.067653:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359558400 00000100:00100000:0.0:1790784411.067655:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359558400 00000100:00100000:0.0:1790784411.067663:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359558528 00000100:00100000:0.0:1790784411.067664:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359558528 00000100:00100000:0.0:1790784411.067675:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790784411.067680:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1877773359558784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784411.067705:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1877773359558784:12345-0@lo:400:kworker.0 Request processed in 25us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784411.067711:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790784411.067719:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790784411.067731:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1877773359558400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784411.067753:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1877773359558400:12345-0@lo:400:kworker.0 Request processed in 22us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784411.067758:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790784411.067767:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790784411.067772:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359558528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784411.067790:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359558528:12345-0@lo:400:kworker.0 Request processed in 18us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784411.067795:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1790784411.067816:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790784411.067820:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790784411.067822:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790784411.068079:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359558528:0@lo:400:kworker.0 00000100:00100000:0.0:1790784411.068092:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1877773359558400:0@lo:400:kworker.0 00010000:00080000:0.0:1790784411.068103:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94592d1e3480 x1877773359558912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784411.068113:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359558912:0@lo:400:kworker.0 00000100:00100000:0.0:1790784411.068152:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359558272:0@lo:400:kworker.0 00000100:00100000:0.0:1790784411.068162:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1877773359558784:0@lo:400:kworker.0 00010000:00080000:0.0:1790784411.068172:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94592d1e2680 x1877773359558656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784411.068181:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359558656:0@lo:400:kworker.0 00000100:00100000:0.0:1790784411.073225:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f4b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359559040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790784411.073294:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784411.073340:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359559040 00000100:00100000:0.0:1790784411.073346:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359559040 00000100:00100000:0.0:1790784411.073405:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790784411.073413:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359559040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790784411.073442:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790784411.073483:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359559040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784411.073491:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1790784411.073528:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593f4b4a80 x1877773359559040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784411.073545:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f4b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359559040:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790784411.132020:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784411.582316:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c3a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359559168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790784411.582401:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784411.582465:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359559168 00000100:00100000:3.0:1790784411.582473:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359559168 00000100:00100000:3.0:1790784411.582512:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790784411.582520:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c3a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359559168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790784411.582549:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790784411.582600:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c3a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359559168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784411.582606:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1790784411.583031:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593c3a0700 x1877773359559168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784411.583051:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c3a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359559168:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790784412.155593:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784413.178939:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784414.125170:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784414.125209:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784414.125238:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784414.125266:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784414.125285:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784414.125365:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344846464 00000100:00100000:1.0:1790784414.125395:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344846464 00000100:00100000:1.0:1790784414.125454:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 223 00000100:00100000:1.0:1790784414.125464:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2350:x1877773344846464:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784414.125521:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2350:x1877773344846464:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 60us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784414.125528:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 223 00000100:00100000:0.0:1790784414.125756:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344846720 00000100:00100000:0.0:1790784414.125761:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344846720 00000100:00100000:0.0:1790784414.125807:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344846592 00000100:00100000:0.0:1790784414.125811:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344846592 00000100:00100000:0.0:1790784414.125832:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 73 00000100:00100000:0.0:1790784414.125839:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c3a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2350:x1877773344846720:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:0.0:1790784414.125871:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c3a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2350:x1877773344846720:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 33us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784414.125878:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 73 00000100:00100000:0.0:1790784414.125891:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 74 00000100:00100000:0.0:1790784414.125897:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c3a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2350:x1877773344846592:12345-192.168.206.32@tcp:400:kworker.0 00000100:00080000:1.0:1790784414.125913:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790784414.125921:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c3a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2350:x1877773344846592:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 25us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784414.125940:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 74 00000100:00100000:1.0:1790784414.125941:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344846976 00000100:00100000:1.0:1790784414.125945:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344846976 00000100:00100000:1.0:1790784414.125971:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344846848 00000100:00100000:1.0:1790784414.125974:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344846848 00000100:00100000:1.0:1790784414.125993:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 35 00000100:00100000:1.0:1790784414.126000:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c3a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2350:x1877773344846976:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784414.126040:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c3a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2350:x1877773344846976:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 41us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784414.126047:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 35 00000100:00100000:1.0:1790784414.126071:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 36 00000100:00100000:1.0:1790784414.126078:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c3a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2350:x1877773344846848:12345-192.168.206.32@tcp:400:kworker.0 00000100:00080000:0.0:1790784414.126097:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790784414.126100:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790784414.126180:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c3a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2350:x1877773344846848:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 101us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784414.126187:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 36 00010000:00010000:0.0:1790784414.202483:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784415.227557:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784416.187914:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359559296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790784416.187988:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784416.187990:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359559424:0@lo:400:kworker.0 00000100:00100000:2.0:1790784416.188035:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784416.188076:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1877773359559936:0@lo:400:kworker.0 00000100:00100000:2.0:1790784416.188100:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784416.188120:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790784416.188125:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1877773359559552:0@lo:400:kworker.0 00000100:00100000:2.0:1790784416.188145:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784416.188161:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359560064:0@lo:400:kworker.0 00000100:00100000:2.0:1790784416.188204:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784416.188242:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359559424 00000100:00100000:2.0:1790784416.188249:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359559424 00000100:00100000:3.0:1790784416.188565:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359559808:0@lo:400:kworker.0 00000100:00100000:3.0:1790784416.188594:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784416.188615:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790784416.188621:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d220e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3282:1877773359559680:0@lo:400:kworker.0 00000100:00100000:3.0:1790784416.188642:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784416.188667:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359559296 00000100:00100000:3.0:1790784416.188671:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359559296 00000100:00100000:3.0:1790784416.188712:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790784416.188721:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c3a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359559296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790784416.188754:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790784416.188793:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c3a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359559296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784416.188800:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790784416.188832:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359560064 00000100:00100000:3.0:1790784416.188836:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359560064 00000100:00080000:1.0:1790784416.189225:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790784416.192560:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790784416.192589:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359559936 00000100:00100000:1.0:1790784416.192598:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359559936 00000100:00100000:1.0:1790784416.192760:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359559552 00000100:00100000:1.0:1790784416.192764:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359559552 00000100:00100000:1.0:1790784416.192777:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359559680 00000100:00100000:1.0:1790784416.192780:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359559680 00000100:00100000:1.0:1790784416.192802:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790784416.192811:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1877773359559936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784416.192898:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1877773359559936:12345-0@lo:400:kworker.0 Request processed in 89us (4797us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784416.192906:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790784416.192921:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790784416.192927:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1877773359559552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784416.192955:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1877773359559552:12345-0@lo:400:kworker.0 Request processed in 29us (4809us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784416.192961:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790784416.192982:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790784416.192989:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c3a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1877773359559680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784416.193017:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c3a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1877773359559680:12345-0@lo:400:kworker.0 Request processed in 29us (4374us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784416.193022:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1790784416.193040:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790784416.193082:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1877773359559552:0@lo:400:kworker.0 00000100:00100000:1.0:1790784416.193093:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1877773359559936:0@lo:400:kworker.0 00000100:00100000:1.0:1790784416.193999:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d220e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3282:1877773359559680:0@lo:400:kworker.0 00010000:00080000:1.0:1790784416.194019:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593d7e4380 x1877773359559296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790784416.194041:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359559296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790784416.194854:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1790784416.194868:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903694c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3279:x1877773359559424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784416.194937:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903694c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3279:x1877773359559424:12345-0@lo:400:kworker.0 Request processed in 73us (6901us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784416.194944:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1790784416.194978:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359559424:0@lo:400:kworker.0 00000100:00100000:2.0:1790784416.197883:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359559808 00000100:00100000:2.0:1790784416.197896:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359559808 00000100:00100000:1.0:1790784416.198850:0:8181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790784416.198870:0:8181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359560064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784416.198963:0:8181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359560064:12345-0@lo:400:kworker.0 Request processed in 102us (10758us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784416.198972:0:8181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790784416.198995:0:8181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790784416.199003:0:8181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c3a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359559808:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1790784416.199024:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94591aa56d80 x1877773359560064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784416.199039:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359560064:0@lo:400:kworker.0 00000100:00100000:1.0:1790784416.199057:0:8181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c3a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359559808:12345-0@lo:400:kworker.0 Request processed in 41us (10448us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784416.199065:0:8181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1790784416.199098:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94591aa57b80 x1877773359559808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790784416.199125:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359559808:0@lo:400:kworker.0 00010000:00010000:0.0:1790784416.250549:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790784416.698647:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790784416.698671:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359560192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790784416.698735:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784416.699009:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359560192 00000100:00100000:0.0:1790784416.699017:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359560192 00000100:00100000:0.0:1790784416.699075:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790784416.701020:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359560192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790784416.701073:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790784416.701168:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359560192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2083us (2433us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784416.701177:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1790784416.701512:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593d7e4380 x1877773359560192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790784416.701533:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359560192:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790784417.276351:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784418.299010:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784419.243089:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784419.243172:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784419.243206:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784419.243247:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344847104 00000100:00100000:2.0:1790784419.243257:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344847104 00000100:00100000:2.0:1790784419.243300:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 225 00000100:00100000:2.0:1790784419.243309:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2349:x1877773344847104:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1790784419.243401:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2349:x1877773344847104:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 66us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784419.243409:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 225 00000100:00100000:3.0:1790784419.249797:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784419.249833:0:8181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344847616 00000100:00100000:3.0:1790784419.249841:0:8181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344847616 00000100:00100000:3.0:1790784419.250017:0:8181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 39 00000100:00100000:3.0:1790784419.250040:0:8181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c3a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2349:x1877773344847616:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1790784419.250110:0:8181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c3a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2349:x1877773344847616:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 84us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784419.250118:0:8181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 39 00000100:00080000:3.0:1790784419.250140:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790784419.250310:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344847232 00000100:00100000:1.0:1790784419.250316:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344847232 00000100:00100000:1.0:1790784419.250367:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344847360 00000100:00100000:1.0:1790784419.250370:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344847360 00000100:00100000:1.0:1790784419.250463:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 78 00000100:00100000:1.0:1790784419.250471:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c3a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2350:x1877773344847232:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:0.0:1790784419.250483:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 79 00000100:00100000:0.0:1790784419.250509:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c3a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2349:x1877773344847360:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784419.250515:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c3a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2350:x1877773344847232:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 42us (7432us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784419.250523:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 78 00000100:00100000:0.0:1790784419.250546:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c3a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2349:x1877773344847360:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 53us (7338us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784419.250552:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 79 00000100:00080000:3.0:1790784419.250872:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790784419.257509:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784419.257853:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344847488 00000100:00100000:2.0:1790784419.257862:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344847488 00000100:00100000:2.0:1790784419.257947:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 40 00000100:00100000:2.0:1790784419.257958:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c3a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2350:x1877773344847488:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1790784419.258044:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c3a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2350:x1877773344847488:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 88us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784419.258052:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 40 00000100:00080000:3.0:1790784419.258798:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790784419.323657:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784420.349049:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784421.306610:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790784421.306632:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359560320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790784421.306696:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784421.306895:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359560320 00000100:00100000:1.0:1790784421.306902:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359560320 00000100:00100000:1.0:1790784421.306948:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790784421.306956:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359560320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790784421.306984:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790784421.307042:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359560320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784421.307049:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1790784421.307088:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790784421.307119:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593d7e4380 x1877773359560320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790784421.307136:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359560320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790784421.308398:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359560448:0@lo:400:kworker.0 00000100:00100000:1.0:1790784421.308421:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1877773359560832:0@lo:400:kworker.0 00000100:00100000:3.0:1790784421.308442:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784421.308446:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784421.308485:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359560960:0@lo:400:kworker.0 00000100:00100000:3.0:1790784421.308512:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784421.308512:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1877773359560576:0@lo:400:kworker.0 00000100:00100000:2.0:1790784421.308538:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784421.308541:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359560448 00000100:00100000:3.0:1790784421.308546:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359560448 00000100:00100000:2.0:1790784421.308564:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359560832 00000100:00100000:2.0:1790784421.308567:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359560832 00000100:00100000:3.0:1790784421.308577:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1790784421.308593:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3279:x1877773359560448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784421.308594:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359560576 00000100:00100000:2.0:1790784421.308596:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359560576 00000100:00100000:2.0:1790784421.308610:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790784421.308615:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1877773359560832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784421.308631:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3279:x1877773359560448:12345-0@lo:400:kworker.0 Request processed in 40us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784421.308637:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1790784421.308641:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1877773359560832:12345-0@lo:400:kworker.0 Request processed in 26us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784421.308652:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790784421.308662:0:8181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359560960 00000100:00100000:2.0:1790784421.308664:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790784421.308665:0:8181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359560960 00000100:00100000:2.0:1790784421.308669:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1877773359560576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784421.308699:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1877773359560576:12345-0@lo:400:kworker.0 Request processed in 30us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784421.308701:0:8181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790784421.308704:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790784421.308707:0:8181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c3a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359560960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784421.308729:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1877773359560576:0@lo:400:kworker.0 00000100:00100000:3.0:1790784421.308734:0:8181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c3a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359560960:12345-0@lo:400:kworker.0 Request processed in 28us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784421.308740:0:8181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1790784421.308767:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593d7e5c00 x1877773359560960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784421.308778:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359560960:0@lo:400:kworker.0 00000100:00100000:3.0:1790784421.308798:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359560448:0@lo:400:kworker.0 00000100:00100000:0.0:1790784421.308860:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359560704:0@lo:400:kworker.0 00000100:00100000:0.0:1790784421.308888:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784421.311867:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359560704 00000100:00100000:2.0:1790784421.311879:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359560704 00000100:00100000:2.0:1790784421.311952:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790784421.311962:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1877773359560704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784421.312070:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1877773359560704:12345-0@lo:400:kworker.0 Request processed in 109us (3181us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784421.312077:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790784421.312600:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359560704:0@lo:400:kworker.0 00000100:00080000:0.0:1790784421.313614:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790784421.313636:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790784421.315210:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1877773359560832:0@lo:400:kworker.0 00010000:00010000:1.0:1790784421.373029:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784421.820121:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790784421.820142:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359561088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790784421.820206:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784421.830819:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359561088 00000100:00100000:1.0:1790784421.830834:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359561088 00000100:00100000:1.0:1790784421.830885:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790784421.830893:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d4c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359561088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790784421.830930:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790784421.831004:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d4c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359561088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (10798us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784421.831011:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1790784421.831161:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94592d4c1500 x1877773359561088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790784421.831181:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359561088:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790784422.395796:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784423.420131:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790784424.363203:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784424.363246:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784424.363278:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784424.363305:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344847872 00000100:00100000:1.0:1790784424.363313:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344847872 00000100:00100000:1.0:1790784424.363359:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344848000 00000100:00100000:1.0:1790784424.363416:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344848000 00000100:00100000:1.0:1790784424.363444:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 83 00000100:00100000:1.0:1790784424.363454:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2351:x1877773344847872:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784424.363522:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2351:x1877773344847872:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 70us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784424.363530:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 83 00000100:00100000:1.0:1790784424.363546:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 84 00000100:00100000:1.0:1790784424.363552:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2351:x1877773344848000:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784424.363575:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2351:x1877773344848000:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 24us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784424.363581:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 84 00000100:00080000:0.0:1790784424.363900:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790784424.364020:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344847744 00000100:00100000:3.0:1790784424.364025:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344847744 00000100:00100000:3.0:1790784424.364068:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 227 00000100:00100000:3.0:1790784424.364076:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2351:x1877773344847744:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1790784424.364118:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2351:x1877773344847744:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 44us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784424.364131:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 227 00000100:00100000:2.0:1790784424.369179:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784424.369218:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784424.369256:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344848128 00000100:00100000:2.0:1790784424.369265:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344848128 00000100:00100000:2.0:1790784424.369312:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344848256 00000100:00100000:2.0:1790784424.369315:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344848256 00000100:00100000:2.0:1790784424.369337:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 14 00000100:00100000:2.0:1790784424.369346:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945910fc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2348:x1877773344848128:12345-192.168.206.32@tcp:9:kworker.0 00000020:00000080:2.0:1790784424.369409:0:6670:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d373a 00000100:00080000:2.0:1790784424.369417:0:6670:0:(import.c:65:import_set_state_nolock()) ffff94592da6a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790784424.369453:0:6670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1790784424.369782:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945910fc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+2:2348:x1877773344848128:12345-192.168.206.32@tcp:9:kworker.0 Request processed in 434us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784424.369801:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 14 00000100:00100000:2.0:1790784424.369939:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 15 00000100:00100000:2.0:1790784424.369947:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2348:x1877773344848256:12345-192.168.206.32@tcp:9:kworker.0 00000020:00000080:2.0:1790784424.369960:0:6670:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d3741 00000100:00080000:2.0:1790784424.369965:0:6670:0:(import.c:65:import_set_state_nolock()) ffff94592da69000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790784424.369985:0:6670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1790784424.370540:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+2:2348:x1877773344848256:12345-192.168.206.32@tcp:9:kworker.0 Request processed in 591us (1318us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784424.370549:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 15 00010000:00010000:2.0:1790784424.370579:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790784424.370596:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790784424.370600:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790784424.372472:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784424.443075:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784425.471157:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784426.427303:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3280:1877773359561600:0@lo:400:kworker.0 00000100:00100000:3.0:1790784426.427417:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784426.427493:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1790784426.427499:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d4c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1877773359561472:0@lo:400:kworker.0 00000100:00100000:3.0:1790784426.427523:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784426.427539:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359561984:0@lo:400:kworker.0 00000100:00100000:3.0:1790784426.427565:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784426.427734:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359561984 00000100:00100000:2.0:1790784426.427744:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359561984 00000100:00100000:0.0:1790784426.428254:0:8181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790784426.428269:0:8181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d4c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359561984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784426.428346:0:8181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d4c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359561984:12345-0@lo:400:kworker.0 Request processed in 81us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784426.428354:0:8181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1790784426.428435:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94592d4c3480 x1877773359561984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784426.428450:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359561984:0@lo:400:kworker.0 00000100:00100000:1.0:1790784426.429273:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f4b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359561216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790784426.429332:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784426.429423:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d4c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359561728:0@lo:400:kworker.0 00000100:00100000:1.0:1790784426.429448:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784426.429471:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790784426.429477:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d4c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359561344:0@lo:400:kworker.0 00000100:00100000:1.0:1790784426.429508:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784426.429533:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d4c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1877773359561856:0@lo:400:kworker.0 00000100:00100000:1.0:1790784426.429557:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784426.429597:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359561600 00000100:00100000:1.0:1790784426.429605:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359561600 00000100:00100000:1.0:1790784426.429656:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359561472 00000100:00100000:1.0:1790784426.429659:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359561472 00000100:00100000:1.0:1790784426.429674:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359561856 00000100:00100000:1.0:1790784426.429677:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359561856 00000100:00100000:1.0:1790784426.429713:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1790784426.429721:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1877773359561600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784426.429776:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1877773359561600:12345-0@lo:400:kworker.0 Request processed in 55us (2358us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784426.429783:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1790784426.429798:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790784426.429804:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1877773359561472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784426.429833:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1877773359561472:12345-0@lo:400:kworker.0 Request processed in 29us (2309us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784426.429838:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790784426.429849:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790784426.429856:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1877773359561856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784426.429887:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1877773359561856:12345-0@lo:400:kworker.0 Request processed in 32us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784426.429893:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790784426.429917:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359561344 00000100:00100000:1.0:1790784426.429920:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359561344 00000100:00100000:1.0:1790784426.429948:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1790784426.429955:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3281:x1877773359561344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784426.429985:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3281:x1877773359561344:12345-0@lo:400:kworker.0 Request processed in 30us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784426.430004:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1790784426.430058:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d4c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359561344:0@lo:400:kworker.0 00000100:00100000:1.0:1790784426.430071:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d4c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1877773359561856:0@lo:400:kworker.0 00000100:00100000:1.0:1790784426.430103:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d4c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1877773359561472:0@lo:400:kworker.0 00000100:00100000:1.0:1790784426.430124:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3280:1877773359561600:0@lo:400:kworker.0 00000100:00100000:0.0:1790784426.430337:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359561216 00000100:00100000:0.0:1790784426.430342:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359561216 00000100:00100000:0.0:1790784426.430404:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790784426.430415:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359561216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790784426.430449:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790784426.430492:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359561216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784426.430499:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1790784426.431982:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790784426.432004:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790784426.432008:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790784426.432950:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359561728 00000100:00100000:2.0:1790784426.432964:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359561728 00000100:00100000:2.0:1790784426.433045:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790784426.433058:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359561728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784426.433167:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359561728:12345-0@lo:400:kworker.0 Request processed in 113us (3717us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784426.433174:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1790784426.433571:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593f4b6d80 x1877773359561216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790784426.433604:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f4b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359561216:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1790784426.433616:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94592d4c2d80 x1877773359561728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790784426.433624:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d4c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359561728:0@lo:400:kworker.0 00010000:00010000:3.0:1790784426.490564:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790784426.510948:0:6693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8 00000020:00000080:3.0:1790784426.510960:0:6693:0:(genops.c:885:class_export_put()) final put ffff94592da6d000/65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8 00000020:00000080:1.0:1790784426.511822:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94592da6d000/65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8 for lustre-OST0000 00000020:00000080:0.0:1790784426.512104:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94592da6a000 for lustre-OST0000 00000100:00100000:3.0:1790784426.947860:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359562112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790784426.947962:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784426.948070:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359562112 00000100:00100000:3.0:1790784426.948081:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359562112 00000100:00100000:3.0:1790784426.948674:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790784426.948690:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d4c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359562112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790784426.948734:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790784426.948809:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d4c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359562112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784426.948816:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1790784426.949412:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94592d4c3b80 x1877773359562112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784426.949438:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359562112:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1790784426.991602:0:7614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8 00000020:00000080:2.0:1790784426.991615:0:7614:0:(genops.c:885:class_export_put()) final put ffff94592da6c800/65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8 00000020:00000080:2.0:1790784426.991646:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94592da6c800/65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8 for lustre-OST0001 00000020:00000080:2.0:1790784426.991727:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94592da69000 for lustre-OST0001 00000001:02000400:3.0:1790784427.304499:0:10990:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1790784427.520674:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784428.538790:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784429.484418:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784429.484843:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784429.484889:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784429.484920:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344848384 00000100:00100000:3.0:1790784429.484929:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344848384 00000100:00100000:0.0:1790784429.486589:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344848512 00000100:00100000:0.0:1790784429.486601:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344848512 00000100:00100000:0.0:1790784429.486665:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344848640 00000100:00100000:0.0:1790784429.486669:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344848640 00000100:00100000:0.0:1790784429.486696:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 88 00000100:00100000:0.0:1790784429.486706:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2352:x1877773344848512:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:0.0:1790784429.486785:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2352:x1877773344848512:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 80us (2375us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784429.486793:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 88 00000100:00100000:0.0:1790784429.486809:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 89 00000100:00100000:0.0:1790784429.486816:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d4c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2352:x1877773344848640:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:0.0:1790784429.486840:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d4c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2352:x1877773344848640:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 25us (1950us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784429.486846:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 89 00000100:00080000:0.0:1790784429.488461:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790784429.490399:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 229 00000100:00100000:3.0:1790784429.490414:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2352:x1877773344848384:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1790784429.490509:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2352:x1877773344848384:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 94us (5664us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784429.490517:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 229 00010000:00010000:0.0:1790784429.563057:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790784430.501153:0:11138:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc6ff70120 20000000:00000080:3.0:1790784430.501172:0:11138:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94592d921800 uarg=0000000000000000 20000000:01000000:3.0:1790784430.501207:0:11138:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1790784430.501282:0:11138:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1790784430.501287:0:11138:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1790784430.506109:0:11139:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1790784430.506702:0:11138:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1790784430.515091:0:11138:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790784430.515118:0:11138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff945901525800/0x2c3a1e2a079d3748 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784430.515136:0:11138:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94593fe75800/0x2c3a1e2a079d36f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d36ed expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784430.515145:0:11138:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff945907103e00/0x2c3a1e2a079d3702 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d36fb expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784430.515152:0:11138:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94593fe74e00/0x2c3a1e2a079d3710 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3709 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784430.515161:0:11138:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff945907102800/0x2c3a1e2a079d3717 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f03 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784430.515192:0:11138:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94593fe74600/0x2c3a1e2a079d372c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f3b expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784430.515199:0:11138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff945901525800/0x2c3a1e2a079d3748 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784430.515734:0:11138:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94593fe74600/0x2c3a1e2a079d372c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f3b expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784430.515824:0:11138:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94593fe74600/0x2c3a1e2a079d372c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f3b expref: 12 pid: 5810 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784430.515939:0:11138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11138:1877773359562240:192.168.206.32@tcp:104: 00010000:00010000:2.0:1790784430.516094:0:11138:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff945907102800/0x2c3a1e2a079d3717 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f03 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784430.516103:0:11138:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff945907102800/0x2c3a1e2a079d3717 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f03 expref: 12 pid: 5811 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784430.516112:0:11138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11138:1877773359562368:192.168.206.32@tcp:104: 00010000:00010000:2.0:1790784430.516144:0:11138:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94593fe74e00/0x2c3a1e2a079d3710 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d3709 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784430.516153:0:11138:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94593fe74e00/0x2c3a1e2a079d3710 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3709 expref: 18 pid: 5810 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784430.516161:0:11138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11138:1877773359562496:0@lo:104: 00000100:00100000:2.0:1790784430.516232:0:11138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790784430.516270:0:11138:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff945907103e00/0x2c3a1e2a079d3702 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d36fb expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784430.516279:0:11138:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff945907103e00/0x2c3a1e2a079d3702 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d36fb expref: 18 pid: 5810 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784430.516294:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359562496 00000100:00100000:2.0:1790784430.516299:0:11138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11138:1877773359562624:0@lo:104: 00000100:00100000:0.0:1790784430.516301:0:5800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359562496 00000100:00100000:2.0:1790784430.516321:0:11138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790784430.516355:0:11138:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94593fe75800/0x2c3a1e2a079d36f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d36ed expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784430.516395:0:11138:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94593fe75800/0x2c3a1e2a079d36f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d36ed expref: 18 pid: 5810 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784430.516404:0:11138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11138:1877773359562752:0@lo:104: 00000100:00100000:2.0:1790784430.516426:0:11138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784430.523726:0:11138:0:(client.c:2716:ptlrpc_set_wait()) set ffff945903313f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790784430.523941:0:11138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11138:1877773359562240:192.168.206.32@tcp:104: 00000100:00100000:2.0:1790784430.523953:0:11138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11138:1877773359562368:192.168.206.32@tcp:104: 00000100:00100000:2.0:1790784430.524243:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784430.524317:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784430.524341:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344848896 00000100:00100000:2.0:1790784430.524348:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344848896 00010000:00010000:2.0:1790784430.524415:0:8421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff945907102800/0x2c3a1e2a079d3717 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f03 expref: 13 pid: 5811 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784430.524444:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344848768 00000100:00100000:2.0:1790784430.524447:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344848768 00010000:00010000:2.0:1790784430.524459:0:8421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94593fe74600/0x2c3a1e2a079d372c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f3b expref: 14 pid: 5810 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784430.524477:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 25 00000100:00100000:2.0:1790784430.524485:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905195450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+14:2351:x1877773344848896:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790784430.524515:0:8421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784430.524533:0:8421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff945907102800/0x2c3a1e2a079d3717 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f03 expref: 14 pid: 5811 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784430.524543:0:8421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff945907102800/0x2c3a1e2a079d3717 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f03 expref: 14 pid: 5811 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784430.524560:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945907102800/0x2c3a1e2a079d3717 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f03 expref: 14 pid: 5811 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784430.524574:0:8421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790784430.524577:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 26 00000100:00100000:3.0:1790784430.524586:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2351:x1877773344848768:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790784430.524594:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784430.524598:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94593fe74600/0x2c3a1e2a079d372c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f3b expref: 13 pid: 5810 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784430.524613:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94593fe74600/0x2c3a1e2a079d372c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f3b expref: 13 pid: 5810 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784430.524618:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905195450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2351:x1877773344848896:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 135us (376us total) trans 0 rc 0/0 00010000:00010000:3.0:1790784430.524623:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94593fe74600/0x2c3a1e2a079d372c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f3b expref: 13 pid: 5810 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784430.524625:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 25 00010000:00010000:3.0:1790784430.524632:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790784430.524650:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+11:2351:x1877773344848768:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 67us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784430.524655:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 26 00000100:00100000:0.0:1790784430.527262:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359562624 00000100:00100000:0.0:1790784430.527277:0:5800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359562624 00000100:00100000:0.0:1790784430.527454:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359562752 00000100:00100000:0.0:1790784430.527458:0:5800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359562752 00000100:00100000:0.0:1790784430.527481:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790784430.527491:0:5800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+5:11138:x1877773359562496:12345-0@lo:104: 00010000:00010000:0.0:1790784430.527512:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff94593fe74400/0x2c3a1e2a079d3709 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d3710 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784430.527658:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790784430.527665:0:5800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+5:11138:x1877773359562496:12345-0@lo:104: Request processed in 177us (11437us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784430.527685:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790784430.527703:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790784430.527709:0:5800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+4:11138:x1877773359562624:12345-0@lo:104: 00010000:00010000:0.0:1790784430.527717:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff945907102600/0x2c3a1e2a079d36fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d3702 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784430.527808:0:11138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11138:1877773359562496:0@lo:104: 00000100:00100000:2.0:1790784430.527818:0:11138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11138:1877773359562624:0@lo:104: 00010000:00010000:3.0:1790784430.529801:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790784430.529814:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff94593fe74400/0x2c3a1e2a079d3709 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d3710 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784430.529825:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74400 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:3.0:1790784430.529853:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff94593fe74400/0x2c3a1e2a079d3709 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d3710 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784430.529863:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff94593fe74400/0x2c3a1e2a079d3709 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d3710 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790784430.529871:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff94593fe74400/0x2c3a1e2a079d3709 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d3710 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790784430.529877:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790784430.530027:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff94593fe74400/0x2c3a1e2a079d3709 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3710 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784430.530035:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790784430.530062:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff94593fe74400/0x2c3a1e2a079d3709 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3710 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784430.530070:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff94593fe74400/0x2c3a1e2a079d3709 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3710 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784430.530086:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790784430.530090:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff945907102600/0x2c3a1e2a079d36fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d3702 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784430.530106:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945907102600 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:2.0:1790784430.530110:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff945907102600/0x2c3a1e2a079d36fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d3702 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784430.530117:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff945907102600/0x2c3a1e2a079d36fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d3702 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790784430.530122:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff945907102600/0x2c3a1e2a079d36fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d3702 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790784430.530126:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1790784430.530129:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359562880:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790784430.530151:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff945907102600/0x2c3a1e2a079d36fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3702 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784430.530157:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790784430.530163:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff945907102600/0x2c3a1e2a079d36fb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3702 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784430.530180:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff945907102600/0x2c3a1e2a079d36fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3702 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784430.530187:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790784430.530188:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784430.530190:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784430.530192:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790784430.530226:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790784430.530235:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359563008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790784430.530254:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784430.530342:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359562880 00000100:00100000:3.0:1790784430.530349:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359562880 00010000:00010000:3.0:1790784430.530391:0:8480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94593fe74e00/0x2c3a1e2a079d3710 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3709 expref: 19 pid: 5810 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784430.530421:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359563008 00000100:00100000:3.0:1790784430.530425:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359563008 00010000:00010000:3.0:1790784430.530436:0:8480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff945907103e00/0x2c3a1e2a079d3702 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d36fb expref: 20 pid: 5810 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784430.530455:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790784430.530462:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+20:3281:x1877773359562880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790784430.530473:0:8480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784430.530478:0:8480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94593fe74e00/0x2c3a1e2a079d3710 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3709 expref: 20 pid: 5810 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784430.530488:0:8480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94593fe74e00/0x2c3a1e2a079d3710 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3709 expref: 20 pid: 5810 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784430.530501:0:8480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94593fe74e00/0x2c3a1e2a079d3710 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d3709 expref: 20 pid: 5810 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784430.530523:0:8480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790784430.530558:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3281:x1877773359562880:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784430.530565:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790784430.530580:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790784430.530586:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:3281:x1877773359563008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790784430.530593:0:8480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784430.530598:0:8480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff945907103e00/0x2c3a1e2a079d3702 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d36fb expref: 18 pid: 5810 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784430.530606:0:8480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff945907103e00/0x2c3a1e2a079d3702 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d36fb expref: 18 pid: 5810 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784430.530615:0:8480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945907103e00/0x2c3a1e2a079d3702 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d36fb expref: 18 pid: 5810 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784430.530624:0:8480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790784430.530651:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:3281:x1877773359563008:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784430.530656:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790784430.530689:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359563008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790784430.530696:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359562880:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790784430.532494:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784430.532550:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1790784430.532563:0:5800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+4:11138:x1877773359562624:12345-0@lo:104: Request processed in 4850us (16237us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784430.532574:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790784430.532611:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790784430.532625:0:5800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+3:11138:x1877773359562752:12345-0@lo:104: 00010000:00010000:0.0:1790784430.532641:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d36ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d36f4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784430.532738:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790784430.532744:0:5800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+3:11138:x1877773359562752:12345-0@lo:104: Request processed in 127us (16318us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784430.532750:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790784430.532857:0:11138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11138:1877773359562752:0@lo:104: 00010000:00010000:2.0:1790784430.532886:0:11138:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff945901525800/0x2c3a1e2a079d3748 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784430.532989:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790784430.532996:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d36ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d36f4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784430.533023:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901525a00 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:3.0:1790784430.533027:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d36ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d36f4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784430.533036:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d36ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d36f4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790784430.533043:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d36ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d36f4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790784430.533049:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790784430.533084:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d36ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d36f4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784430.533091:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790784430.533110:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d36ed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d36f4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784430.533117:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d36ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d36f4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784430.533133:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784430.533135:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784430.533137:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784430.533147:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359563136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790784430.533181:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784430.533225:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359563136 00000100:00100000:3.0:1790784430.533231:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359563136 00010000:00010000:3.0:1790784430.533254:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94593fe75800/0x2c3a1e2a079d36f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d36ed expref: 17 pid: 5810 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784430.533284:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790784430.533290:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d4c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:3279:x1877773359563136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790784430.533300:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784430.533305:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94593fe75800/0x2c3a1e2a079d36f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d36ed expref: 17 pid: 5810 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784430.533314:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94593fe75800/0x2c3a1e2a079d36f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d36ed expref: 17 pid: 5810 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784430.533340:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94593fe75800/0x2c3a1e2a079d36f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d36ed expref: 17 pid: 5810 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784430.533353:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff945901525800/0x2c3a1e2a079d3748 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784430.533361:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945901525800/0x2c3a1e2a079d3748 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784430.533398:0:5803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff945901525800/0x2c3a1e2a079d3748 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784430.533405:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff945901525800/0x2c3a1e2a079d3748 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784430.533411:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff945901525800/0x2c3a1e2a079d3748 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784430.533417:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff945901525800/0x2c3a1e2a079d3748 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784430.533431:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901525800 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:3.0:1790784430.533435:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff945901525800/0x2c3a1e2a079d3748 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784430.533442:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff945901525800/0x2c3a1e2a079d3748 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784430.533453:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff945901525800/0x2c3a1e2a079d3748 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784430.533462:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790784430.533490:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d4c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:3279:x1877773359563136:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784430.533497:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790784430.533523:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359563136:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790784430.533599:0:11138:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff945901525800/0x2c3a1e2a079d3748 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784430.533607:0:11138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff945901525800/0x2c3a1e2a079d3748 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784430.533613:0:11138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945901525800/0x2c3a1e2a079d3748 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784430.586672:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784431.547306:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f4b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359563264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790784431.547395:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784431.547463:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359563264 00000100:00100000:0.0:1790784431.547471:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359563264 00000100:00100000:0.0:1790784431.547535:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790784431.547545:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359563264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790784431.547577:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790784431.547638:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359563264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784431.547647:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1790784431.547669:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790784431.547700:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593f4b6300 x1877773359563264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784431.547721:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f4b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359563264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790784431.548943:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f4b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1877773359563520:0@lo:400:kworker.0 00000100:00100000:0.0:1790784431.548997:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784431.549036:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790784431.549042:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f4b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359563392:0@lo:400:kworker.0 00000100:00100000:0.0:1790784431.549068:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784431.549092:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f4b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359563904:0@lo:400:kworker.0 00000100:00100000:0.0:1790784431.549129:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784431.550259:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359563520 00000100:00100000:0.0:1790784431.550276:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359563520 00000100:00100000:0.0:1790784431.550327:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790784431.550335:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1877773359563520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784431.550829:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1877773359563520:12345-0@lo:400:kworker.0 Request processed in 492us (1829us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784431.550837:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790784431.550861:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359563392 00000100:00100000:0.0:1790784431.550865:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359563392 00000100:00100000:0.0:1790784431.550890:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1790784431.550896:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:3282:x1877773359563392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784431.550924:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:3282:x1877773359563392:12345-0@lo:400:kworker.0 Request processed in 28us (1855us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784431.550941:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1790784431.550978:0:8181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359563904 00000100:00100000:0.0:1790784431.550981:0:8181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359563904 00000100:00100000:0.0:1790784431.551023:0:8181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790784431.551030:0:8181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359563904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784431.551058:0:8181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359563904:12345-0@lo:400:kworker.0 Request processed in 30us (1929us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784431.551064:0:8181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790784431.551089:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f4b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359563648:0@lo:400:kworker.0 00000100:00100000:0.0:1790784431.551115:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784431.551136:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790784431.551142:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f4b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1877773359563776:0@lo:400:kworker.0 00000100:00100000:0.0:1790784431.551162:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784431.551186:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359563648 00000100:00100000:0.0:1790784431.551189:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359563648 00000100:00100000:0.0:1790784431.551211:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359563776 00000100:00100000:0.0:1790784431.551213:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359563776 00000100:00100000:0.0:1790784431.551232:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790784431.551238:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359563648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784431.551284:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359563648:12345-0@lo:400:kworker.0 Request processed in 46us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784431.551289:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790784431.551301:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790784431.551307:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1877773359563776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784431.551332:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1877773359563776:12345-0@lo:400:kworker.0 Request processed in 26us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784431.551629:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1790784431.551650:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790784431.551654:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790784431.551690:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f4b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1877773359563776:0@lo:400:kworker.0 00000100:00100000:0.0:1790784431.551701:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f4b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359563648:0@lo:400:kworker.0 00000100:00100000:0.0:1790784431.551732:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f4b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359563392:0@lo:400:kworker.0 00010000:00080000:0.0:1790784431.551744:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593f4b7b80 x1877773359563904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784431.551755:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f4b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359563904:0@lo:400:kworker.0 00000100:00100000:0.0:1790784431.551766:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f4b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1877773359563520:0@lo:400:kworker.0 00000100:00100000:2.0:1790784431.605335:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784431.605514:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344849024 00000100:00100000:3.0:1790784431.605523:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344849024 00000100:00100000:3.0:1790784431.605609:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 231 00000100:00100000:3.0:1790784431.605620:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903696c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+11:5593:x1877773344849024:12345-192.168.206.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790784431.605638:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784431.605656:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945901524000/0x2c3a1e2a079d374f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x394e0d8838134f65 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784431.605683:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945901524000/0x2c3a1e2a079d374f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f65 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784431.605695:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945901524000/0x2c3a1e2a079d374f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f65 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784431.605715:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945901524000, rc 0) 00000100:00100000:3.0:1790784431.605803:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903696c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+12:5593:x1877773344849024:12345-192.168.206.32@tcp:101:ll_cfg_requeue.0 Request processed in 184us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784431.605810:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 231 00000100:00100000:2.0:1790784431.608656:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784431.608742:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344849152 00000100:00100000:0.0:1790784431.608751:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344849152 00000100:00100000:0.0:1790784431.608834:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 232 00000100:00100000:0.0:1790784431.608844:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903694850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+12:5593:x1877773344849152:12345-192.168.206.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790784431.609148:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903694850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+12:5593:x1877773344849152:12345-192.168.206.32@tcp:501:ll_cfg_requeue.0 Request processed in 305us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784431.609155:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 232 00010000:00010000:3.0:1790784431.613536:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784431.613637:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784431.613732:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344849280 00000100:00100000:3.0:1790784431.613741:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344849280 00000100:00100000:3.0:1790784431.613832:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 233 00000100:00100000:3.0:1790784431.613843:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+12:5593:x1877773344849280:12345-192.168.206.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790784431.614873:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+12:5593:x1877773344849280:12345-192.168.206.32@tcp:503:ll_cfg_requeue.0 Request processed in 1027us (1234us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784431.614885:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 233 00000100:00100000:2.0:1790784431.620726:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784431.620918:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344849408 00000100:00100000:0.0:1790784431.620927:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344849408 00000100:00100000:0.0:1790784431.620989:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 234 00000100:00100000:0.0:1790784431.620999:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+12:5593:x1877773344849408:12345-192.168.206.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790784431.621018:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784431.621034:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945907102800/0x2c3a1e2a079d3756 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x394e0d8838134f6c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784431.621074:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945907102800/0x2c3a1e2a079d3756 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f6c expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784431.621086:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945907102800/0x2c3a1e2a079d3756 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f6c expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784431.621096:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945907102800, rc 0) 00000100:00100000:0.0:1790784431.621522:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:5593:x1877773344849408:12345-192.168.206.32@tcp:101:ll_cfg_requeue.0 Request processed in 522us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784431.621530:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 234 00000100:00100000:2.0:1790784431.629071:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784431.629412:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344849536 00000100:00100000:3.0:1790784431.629421:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344849536 00000100:00100000:3.0:1790784431.629462:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 235 00000100:00100000:3.0:1790784431.629471:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:5593:x1877773344849536:12345-192.168.206.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790784431.629727:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:5593:x1877773344849536:12345-192.168.206.32@tcp:501:ll_cfg_requeue.0 Request processed in 256us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784431.629735:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 235 00000100:00100000:2.0:1790784431.632162:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784431.632576:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344849664 00000100:00100000:1.0:1790784431.632586:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344849664 00000100:00100000:1.0:1790784431.632639:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 236 00000100:00100000:1.0:1790784431.632648:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:5593:x1877773344849664:12345-192.168.206.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790784431.632844:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:5593:x1877773344849664:12345-192.168.206.32@tcp:503:ll_cfg_requeue.0 Request processed in 197us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784431.632853:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 236 00000100:00100000:0.0:1790784432.058623:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359564032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790784432.058691:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784432.058800:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359564032 00000100:00100000:3.0:1790784432.058809:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359564032 00000100:00100000:3.0:1790784432.058860:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790784432.058870:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359564032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790784432.058901:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790784432.058958:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359564032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784432.058976:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1790784432.059935:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94592d4c1c00 x1877773359564032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784432.059958:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359564032:0@lo:13:osp-pre-1-0.0 10000000:01000000:3.0:1790784432.126147:0:5815:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790784432.126156:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94593fa9a800 from 7 10000000:01000000:3.0:1790784432.126161:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790784432.126208:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945901525e00/0x2c3a1e2a079d375d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784432.126220:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff945901525e00/0x2c3a1e2a079d375d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784432.126232:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff945901525e00/0x2c3a1e2a079d375d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784432.126257:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d4c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359564160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790784432.126321:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784432.126466:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff945906b72600 going to sleep for 11 seconds 00000100:00100000:0.0:1790784432.133467:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359564160 00000100:00100000:0.0:1790784432.133481:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359564160 00000100:00100000:1.0:1790784432.134395:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1790784432.134406:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:5815:x1877773359564160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790784432.134423:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784432.134451:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94590955f400/0x2c3a1e2a079d3764 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d375d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784432.134480:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94590955f400/0x2c3a1e2a079d3764 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d375d expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784432.134490:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94590955f400/0x2c3a1e2a079d3764 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d375d expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784432.134498:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94590955f400, rc 0) 00000100:00100000:1.0:1790784432.134572:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:5815:x1877773359564160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (8250us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784432.134578:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1790784432.135075:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d4c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359564160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790784432.135094:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff945901525e00/0x2c3a1e2a079d375d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3764 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784432.135104:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff945901525e00/0x2c3a1e2a079d375d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d3764 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784432.135179:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d4c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359564288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790784432.135216:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784432.135248:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff945906b72600 going to sleep for 11 seconds 00000100:00100000:3.0:1790784432.135264:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359564288 00000100:00100000:3.0:1790784432.135277:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359564288 00000100:00100000:3.0:1790784432.135306:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1790784432.135313:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:5815:x1877773359564288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790784432.135556:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:5815:x1877773359564288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 243us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784432.135564:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1790784432.135596:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d4c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359564288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790784432.135623:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d4c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359564416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790784432.135659:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784432.135674:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff945906b72600 going to sleep for 11 seconds 00000100:00100000:3.0:1790784432.135685:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359564416 00000100:00100000:3.0:1790784432.135689:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359564416 00000100:00100000:3.0:1790784432.135706:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1790784432.135713:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:5815:x1877773359564416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790784432.136890:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:5815:x1877773359564416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1172us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784432.136900:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1790784432.137199:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d4c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359564416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790784432.141242:0:11190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1790784432.141487:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1790784432.141509:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790784432.141518:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945901525e00/0x2c3a1e2a079d375d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3764 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784432.141530:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff945901525e00/0x2c3a1e2a079d375d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3764 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790784432.141541:0:5815:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790784432.141543:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9459050db000 from 7 10000000:01000000:3.0:1790784432.141554:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790784432.141588:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d376b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784432.141596:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d376b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784432.141607:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d376b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784432.141630:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d4c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359564544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790784432.141688:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784432.141719:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff945907d92840 going to sleep for 11 seconds 00000100:00100000:2.0:1790784432.141767:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359564544 00000100:00100000:2.0:1790784432.141774:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359564544 00000100:00100000:2.0:1790784432.141824:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1790784432.141832:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:5815:x1877773359564544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790784432.141844:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784432.141855:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94593fe75c00/0x2c3a1e2a079d3772 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d376b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784432.141876:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94593fe75c00/0x2c3a1e2a079d3772 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d376b expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784432.141887:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94593fe75c00/0x2c3a1e2a079d3772 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d376b expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784432.141900:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe75c00, rc 0) 00000100:00100000:2.0:1790784432.141933:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:5815:x1877773359564544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784432.141939:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1790784432.142027:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d4c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359564544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790784432.142040:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d376b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3772 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784432.142048:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d376b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d3772 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784432.142087:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d4c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359564672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790784432.142109:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784432.142129:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff945907d92840 going to sleep for 11 seconds 00000100:00100000:2.0:1790784432.142214:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359564672 00000100:00100000:2.0:1790784432.142218:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359564672 00000100:00100000:2.0:1790784432.142244:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1790784432.142250:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:5815:x1877773359564672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790784432.142462:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:5815:x1877773359564672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 211us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784432.142468:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1790784432.142532:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d4c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359564672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790784432.142553:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d4c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359564800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790784432.142583:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784432.142603:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff945907d92840 going to sleep for 11 seconds 00000100:00100000:3.0:1790784432.142615:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359564800 00000100:00100000:3.0:1790784432.142622:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359564800 00000100:00100000:3.0:1790784432.142643:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1790784432.142648:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:5815:x1877773359564800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790784432.142765:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:5815:x1877773359564800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784432.142771:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1790784432.142801:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d4c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359564800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790784432.150125:0:11191:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1790784432.150494:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1790784432.150514:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790784432.150524:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d376b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3772 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784432.150537:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d376b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3772 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790784432.150547:0:5815:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790784432.150559:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff945905fd5000 from 7 10000000:01000000:0.0:1790784432.150562:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790784432.150600:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945907102e00/0x2c3a1e2a079d3779 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784432.150609:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff945907102e00/0x2c3a1e2a079d3779 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784432.150620:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff945907102e00/0x2c3a1e2a079d3779 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784432.150643:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f4b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359564928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790784432.150703:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784432.150752:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905596b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790784432.150867:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359564928 00000100:00100000:3.0:1790784432.150874:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359564928 00000100:00100000:3.0:1790784432.150922:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1790784432.150931:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:5815:x1877773359564928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790784432.150944:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784432.150956:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945901525800/0x2c3a1e2a079d3780 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d3779 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784432.150990:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945901525800/0x2c3a1e2a079d3780 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3779 expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784432.151008:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945901525800/0x2c3a1e2a079d3780 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3779 expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784432.151015:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945901525800, rc 0) 00000100:00100000:3.0:1790784432.151053:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:5815:x1877773359564928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784432.151060:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1790784432.151203:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f4b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359564928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790784432.151216:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff945907102e00/0x2c3a1e2a079d3779 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3780 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784432.151225:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff945907102e00/0x2c3a1e2a079d3779 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d3780 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784432.151277:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f4b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359565056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790784432.151303:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784432.151327:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905596b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790784432.151395:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359565056 00000100:00100000:3.0:1790784432.151400:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359565056 00000100:00100000:3.0:1790784432.151433:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1790784432.151439:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:5815:x1877773359565056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790784432.151659:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:5815:x1877773359565056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 219us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784432.151666:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1790784432.153854:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f4b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359565056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790784432.153915:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f4b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359565184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790784432.154083:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784432.154128:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905596b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790784432.154159:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359565184 00000100:00100000:0.0:1790784432.154165:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359565184 00000100:00100000:0.0:1790784432.154213:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1790784432.154222:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:5815:x1877773359565184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790784432.154429:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:5815:x1877773359565184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784432.154436:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1790784432.154482:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f4b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359565184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790784432.159950:0:11192:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1790784432.164273:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1790784432.164304:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790784432.164315:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945907102e00/0x2c3a1e2a079d3779 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3780 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784432.164328:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff945907102e00/0x2c3a1e2a079d3779 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3780 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784432.637968:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784433.660713:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784434.614964:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784434.615052:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784434.615081:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784434.616661:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344849792 00000100:00100000:2.0:1790784434.616672:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344849792 00000100:00100000:2.0:1790784434.616723:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 246 00000100:00100000:2.0:1790784434.616732:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2352:x1877773344849792:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1790784434.616796:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2352:x1877773344849792:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 65us (1849us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784434.616803:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 246 00000100:00100000:0.0:1790784434.617071:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344850048 00000100:00100000:0.0:1790784434.617076:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344850048 00000100:00100000:0.0:1790784434.617216:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344849920 00000100:00100000:0.0:1790784434.617220:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344849920 00000100:00100000:1.0:1790784434.617260:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 93 00000100:00100000:1.0:1790784434.617268:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d4c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2352:x1877773344850048:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784434.617307:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d4c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2352:x1877773344850048:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 41us (2255us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784434.617314:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 93 00000100:00080000:2.0:1790784434.617358:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790784434.617697:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 94 00000100:00100000:0.0:1790784434.617705:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2352:x1877773344849920:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:0.0:1790784434.617741:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2352:x1877773344849920:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 37us (2659us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784434.617747:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 94 00010000:00010000:0.0:1790784434.686638:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790784434.953002:0:11337:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg632-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790784435.707917:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784436.666675:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f4b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359565312:0@lo:400:kworker.0 00000100:00100000:0.0:1790784436.666765:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784436.666825:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f4b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1877773359565824:0@lo:400:kworker.0 00000100:00100000:0.0:1790784436.666858:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784436.666988:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f4b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359565568:0@lo:400:kworker.0 00000100:00100000:2.0:1790784436.667142:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784436.667174:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790784436.667181:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f4b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359565696:0@lo:400:kworker.0 00000100:00100000:2.0:1790784436.667211:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784436.667240:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f4b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1877773359565440:0@lo:400:kworker.0 00000100:00100000:2.0:1790784436.667282:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784436.667317:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f4b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359565952:0@lo:400:kworker.0 00000100:00100000:2.0:1790784436.667342:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784436.667399:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359565824 00000100:00100000:2.0:1790784436.667408:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359565824 00000100:00100000:2.0:1790784436.667463:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359565568 00000100:00100000:2.0:1790784436.667467:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359565568 00000100:00100000:2.0:1790784436.667613:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359565440 00000100:00100000:2.0:1790784436.667618:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359565440 00000100:00100000:2.0:1790784436.667634:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790784436.667644:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1877773359565824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784436.667718:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1877773359565824:12345-0@lo:400:kworker.0 Request processed in 75us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784436.667726:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790784436.667746:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790784436.667752:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1877773359565568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784436.667775:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f4b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1877773359565824:0@lo:400:kworker.0 00000100:00100000:2.0:1790784436.667782:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1877773359565568:12345-0@lo:400:kworker.0 Request processed in 30us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784436.667803:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790784436.667818:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790784436.667824:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1877773359565440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784436.667863:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1877773359565440:12345-0@lo:400:kworker.0 Request processed in 38us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784436.667869:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790784436.667889:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359565696 00000100:00100000:2.0:1790784436.667892:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359565696 00000100:00100000:2.0:1790784436.667926:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359565952 00000100:00100000:2.0:1790784436.667929:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359565952 00000100:00100000:2.0:1790784436.667965:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790784436.667972:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359565696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784436.667979:0:8181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790784436.667987:0:8181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359565952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784436.668003:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359565696:12345-0@lo:400:kworker.0 Request processed in 32us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784436.668009:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790784436.668018:0:8181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359565952:12345-0@lo:400:kworker.0 Request processed in 32us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784436.668023:0:8181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1790784436.668112:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790784436.668117:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790784436.668121:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790784436.668152:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f4b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1877773359565440:0@lo:400:kworker.0 00010000:00080000:2.0:1790784436.668165:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593f4b5500 x1877773359565952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790784436.668176:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f4b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359565952:0@lo:400:kworker.0 00000100:00100000:2.0:1790784436.668199:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359566080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790784436.668229:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1790784436.668264:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593f4b4380 x1877773359565696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790784436.668280:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f4b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359565696:0@lo:400:kworker.0 00000100:00100000:2.0:1790784436.668293:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f4b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359565568:0@lo:400:kworker.0 00000100:00100000:2.0:1790784436.668332:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359565312 00000100:00100000:2.0:1790784436.668336:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359565312 00000100:00100000:1.0:1790784436.668356:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359566080 00000100:00100000:2.0:1790784436.668361:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1790784436.668361:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359566080 00000100:00100000:2.0:1790784436.668368:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3279:x1877773359565312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784436.668434:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3279:x1877773359565312:12345-0@lo:400:kworker.0 Request processed in 67us (1670us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784436.668441:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1790784436.668566:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790784436.668588:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359566080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790784436.668626:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790784436.668683:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f4b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359565312:0@lo:400:kworker.0 00000100:00100000:1.0:1790784436.668746:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359566080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (511us total) trans 0 rc 0/0 00010000:00080000:2.0:1790784436.668753:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593d7e6680 x1877773359566080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790784436.668762:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790784436.668790:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359566080:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790784436.731960:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784437.179867:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359566208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790784437.179928:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784437.180009:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359566208 00000100:00100000:3.0:1790784437.180017:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359566208 00000100:00100000:3.0:1790784437.180059:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790784437.180068:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359566208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790784437.180102:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790784437.180144:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359566208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784437.180151:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1790784437.180189:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94592d4c3b80 x1877773359566208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784437.180207:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359566208:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790784437.757053:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784438.778788:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790784439.028208:0:11437:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 12:07:17 (1790784437) === 00000100:00100000:2.0:1790784439.182922:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784439.183032:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784439.183478:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344850304 00000100:00100000:0.0:1790784439.183493:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344850304 00000100:00100000:0.0:1790784439.183737:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 0 00000100:00100000:0.0:1790784439.183752:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:9678:x1877773344850304:12345-192.168.206.32@tcp:700:mkdir.0 00000100:00100000:0.0:1790784439.183853:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:9678:x1877773344850304:12345-192.168.206.32@tcp:700:mkdir.0 Request processed in 106us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784439.183862:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 0 00000100:00080000:2.0:1790784439.186021:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790784439.187963:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344850176 00000100:00100000:3.0:1790784439.187990:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344850176 00000100:00100000:3.0:1790784439.188064:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 14 00000100:00100000:3.0:1790784439.188076:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2351:x1877773344850176:12345-192.168.206.32@tcp:41:mkdir.0 00000004:00000024:3.0:1790784439.188132:0:5820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790784439.189857:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784439.190025:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344850560 00000100:00100000:2.0:1790784439.190035:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344850560 00000100:00100000:2.0:1790784439.190091:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 15 00000100:00100000:2.0:1790784439.190102:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:9678:x1877773344850560:12345-192.168.206.32@tcp:36:mkdir.0 00010000:00010000:2.0:1790784439.190173:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784439.190322:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945909575e00/0x2c3a1e2a079d3668 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134eee expref: 7 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784439.190342:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2351:x1877773344850176:12345-192.168.206.32@tcp:41:mkdir.0 Request processed in 1515us (6681us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784439.190364:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 14 00010000:00010000:2.0:1790784439.190371:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2200) 00010000:00010000:2.0:1790784439.190434:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790784439.190802:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3787 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.190817:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3787 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.190830:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3787 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.192034:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d378e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.192053:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d378e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.192066:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d378e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784439.198169:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790784439.198189:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3787 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.198201:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3787 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.198209:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3787 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.198216:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784439.199022:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3787 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.199033:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3787 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.199050:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2b00) 00010000:00010000:2.0:1790784439.199053:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784439.199058:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3787 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.199064:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3787 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790784439.199085:0:5818:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bc38ba9a reply state 000000003020daf7 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d378e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784439.199095:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790784439.199203:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:9678:x1877773344850560:12345-192.168.206.32@tcp:36:mkdir.0 Request processed in 9099us (9348us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1790784439.199213:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 15 00010000:00010000:3.0:1790784439.206710:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d378e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784439.206730:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d378e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784439.206740:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d378e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784439.206746:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75600 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784439.206751:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d378e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784439.206758:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d378e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784439.206779:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff945903af2400) 00010000:00010000:3.0:1790784439.206783:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784439.206788:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d378e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784439.206794:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d378e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784439.224356:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784439.224442:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344850688 00000100:00100000:2.0:1790784439.224455:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344850688 00000100:00100000:2.0:1790784439.224524:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 16 00000100:00100000:2.0:1790784439.224547:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:9679:x1877773344850688:12345-192.168.206.32@tcp:101:chmod.0 00010000:00010000:2.0:1790784439.224579:0:9249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784439.224607:0:9249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3795 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838134f73 expref: -99 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.224694:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74a00/0x2c3a1e2a079d379c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.224722:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74a00/0x2c3a1e2a079d379c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.224735:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74a00/0x2c3a1e2a079d379c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784439.224779:0:9249:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790784439.224783:0:9249:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790784439.224832:0:9249:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74a00/0x2c3a1e2a079d379c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.224862:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3795 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f73 expref: 8 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.224881:0:9249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74a00/0x2c3a1e2a079d379c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f73 expref: 7 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.224995:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2b00) 00010000:00010000:2.0:1790784439.224998:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790784439.225003:0:9249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74a00, rc 0) 00000100:00100000:2.0:1790784439.225083:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:9679:x1877773344850688:12345-192.168.206.32@tcp:101:chmod.0 Request processed in 549us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784439.225091:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 16 00000100:00100000:2.0:1790784439.235647:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784439.244049:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344850944 00000100:00100000:0.0:1790784439.244071:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344850944 00000100:00100000:0.0:1790784439.244158:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 17 00000100:00100000:0.0:1790784439.244172:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:9679:x1877773344850944:12345-192.168.206.32@tcp:36:chmod.0 00010000:00010000:0.0:1790784439.244245:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784439.244290:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74a00/0x2c3a1e2a079d379c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f73 expref: 7 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.244316:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2b00) 00010000:00010000:0.0:1790784439.244331:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790784439.244365:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d37a3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.244402:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d37a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.244414:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d37a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790784439.244802:0:5819:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a61968fd reply state 0000000047bdc6b6 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d37a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784439.244815:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790784439.244824:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1790784439.244946:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:9679:x1877773344850944:12345-192.168.206.32@tcp:36:chmod.0 Request processed in 775us (9305us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1790784439.244965:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 17 00010000:00010000:2.0:1790784439.259454:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d37a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.259478:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d37a3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.259497:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d37a3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.259855:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945907103c00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784439.259864:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d37a3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.259888:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d37a3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.259908:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903a23300) 00010000:00010000:2.0:1790784439.259912:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790784439.259918:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d37a3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.259939:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d37a3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784439.294081:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784439.294898:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344851072 00000100:00100000:1.0:1790784439.294914:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344851072 00000100:00100000:1.0:1790784439.294999:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 18 00000100:00100000:1.0:1790784439.295012:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:9680:x1877773344851072:12345-192.168.206.32@tcp:101:chown.0 00010000:00010000:1.0:1790784439.295044:0:9249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784439.295076:0:9249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d37aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838134f7a expref: -99 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.295164:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d37b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.295180:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d37b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.295195:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d37b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790784439.295239:0:9249:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790784439.295256:0:9249:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790784439.295306:0:9249:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d37b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.295339:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d37aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f7a expref: 9 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.295362:0:9249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d37b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f7a expref: 8 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.295674:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94590345dd00) 00010000:00010000:1.0:1790784439.295678:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790784439.295683:0:9249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94590955e000, rc 0) 00000100:00100000:1.0:1790784439.295771:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:9680:x1877773344851072:12345-192.168.206.32@tcp:101:chown.0 Request processed in 761us (1701us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784439.295780:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 18 00000100:00100000:1.0:1790784439.298806:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784439.298908:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344851200 00000100:00100000:0.0:1790784439.298918:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344851200 00000100:00100000:0.0:1790784439.299080:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 19 00000100:00100000:0.0:1790784439.299092:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:9680:x1877773344851200:12345-192.168.206.32@tcp:101:chown.0 00010000:00010000:0.0:1790784439.299113:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784439.299133:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945907102c00/0x2c3a1e2a079d37b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838134f81 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.299209:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945907103800/0x2c3a1e2a079d37bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.299223:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945907103800/0x2c3a1e2a079d37bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.299234:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945907103800/0x2c3a1e2a079d37bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.299249:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945907102000/0x2c3a1e2a079d37c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.299256:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945907102000/0x2c3a1e2a079d37c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.299262:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945907102000/0x2c3a1e2a079d37c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.299345:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d37cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.299368:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d37cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.299412:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d37cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790784439.299444:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790784439.299448:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790784439.299469:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d37cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.299483:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945907103800/0x2c3a1e2a079d37bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.299491:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945907103800/0x2c3a1e2a079d37bf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.299499:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945907103800/0x2c3a1e2a079d37bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.299506:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945907103800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784439.299510:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945907103800/0x2c3a1e2a079d37bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.299518:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945907103800/0x2c3a1e2a079d37bf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.299530:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94590345dd00) 00010000:00010000:0.0:1790784439.299533:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784439.299539:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945907103800/0x2c3a1e2a079d37bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.299880:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945907103800/0x2c3a1e2a079d37bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.299894:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945907102000/0x2c3a1e2a079d37c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.299901:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945907102000/0x2c3a1e2a079d37c6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.299908:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945907102000/0x2c3a1e2a079d37c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.299915:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945907102000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784439.299918:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945907102000/0x2c3a1e2a079d37c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.300104:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945907102000/0x2c3a1e2a079d37c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.300115:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff945903a23400) 00010000:00010000:0.0:1790784439.300118:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784439.300121:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945907102000/0x2c3a1e2a079d37c6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.300126:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945907102000/0x2c3a1e2a079d37c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.300179:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945907102c00/0x2c3a1e2a079d37b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f81 expref: 10 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.300194:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d37cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f81 expref: 9 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.300211:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff945903a23500) 00010000:00010000:0.0:1790784439.300213:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790784439.300216:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945907103c00, rc 0) 00000100:00100000:0.0:1790784439.300276:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+9:9680:x1877773344851200:12345-192.168.206.32@tcp:101:chown.0 Request processed in 1186us (1477us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784439.300284:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 19 00000100:00100000:1.0:1790784439.305244:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784439.305318:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344851456 00000100:00100000:0.0:1790784439.305326:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344851456 00000100:00100000:0.0:1790784439.305414:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 20 00000100:00100000:0.0:1790784439.305424:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+9:9680:x1877773344851456:12345-192.168.206.32@tcp:36:chown.0 00010000:00010000:0.0:1790784439.305475:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784439.305499:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d37cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f81 expref: 9 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.305517:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff945903a23500) 00010000:00010000:0.0:1790784439.305527:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790784439.306568:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945907103e00/0x2c3a1e2a079d37d4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.306598:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945907103e00/0x2c3a1e2a079d37d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.306614:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945907103e00/0x2c3a1e2a079d37d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790784439.405297:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:3.0:1790784439.405314:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1790784439.405473:0:5820:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000040068971 reply state 000000007b31d3e7 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff945907103e00/0x2c3a1e2a079d37d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784439.405486:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790784439.405510:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:2.0:1790784439.405912:0:5820:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1790784439.405944:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:9680:x1877773344851456:12345-192.168.206.32@tcp:36:chown.0 Request processed in 100517us (100704us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1790784439.405954:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 20 00010000:00010000:3.0:1790784439.406176:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945907103e00/0x2c3a1e2a079d37d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784439.406186:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945907103e00/0x2c3a1e2a079d37d4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784439.406194:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945907103e00/0x2c3a1e2a079d37d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784439.406200:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945907103e00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784439.406204:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945907103e00/0x2c3a1e2a079d37d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784439.406212:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945907103e00/0x2c3a1e2a079d37d4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784439.406226:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff945903a23900) 00010000:00010000:3.0:1790784439.406229:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790784439.406234:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945907103e00/0x2c3a1e2a079d37d4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784439.406240:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945907103e00/0x2c3a1e2a079d37d4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784439.430137:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784439.430313:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344851584 00000100:00100000:3.0:1790784439.430323:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344851584 00000100:00100000:3.0:1790784439.430423:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 21 00000100:00100000:3.0:1790784439.430433:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:9681:x1877773344851584:12345-192.168.206.32@tcp:101:touch.500 00010000:00010000:3.0:1790784439.430471:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784439.430492:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d37db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838134f88 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790784439.433473:0:5818:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2933us 00010000:00010000:0.0:1790784439.446699:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d37e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.446721:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d37e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.446733:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d37e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.446748:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945907102c00/0x2c3a1e2a079d37e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.446765:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945907102c00/0x2c3a1e2a079d37e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.446772:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945907102c00/0x2c3a1e2a079d37e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.447100:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945907102000/0x2c3a1e2a079d37f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.447109:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945907102000/0x2c3a1e2a079d37f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.447116:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945907102000/0x2c3a1e2a079d37f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790784439.447136:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790784439.447139:0:5818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790784439.447172:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945907102000/0x2c3a1e2a079d37f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.447183:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d37e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.447190:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d37e2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.447197:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d37e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.447202:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945907103c00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784439.447206:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d37e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.447219:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d37e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.447232:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94590345dd00) 00010000:00010000:0.0:1790784439.447235:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784439.447239:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d37e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.447245:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d37e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.447254:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945907102c00/0x2c3a1e2a079d37e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.447260:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945907102c00/0x2c3a1e2a079d37e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.447265:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945907102c00/0x2c3a1e2a079d37e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.447270:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945907102c00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784439.447272:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945907102c00/0x2c3a1e2a079d37e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.447277:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945907102c00/0x2c3a1e2a079d37e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.447282:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff945903a23500) 00010000:00010000:0.0:1790784439.447285:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784439.447287:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945907102c00/0x2c3a1e2a079d37e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.447301:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945907102c00/0x2c3a1e2a079d37e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.447333:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d37db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f88 expref: 8 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.447347:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945907102000/0x2c3a1e2a079d37f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f88 expref: 7 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.447353:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff945903a23e00) 00010000:00010000:0.0:1790784439.447355:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790784439.447357:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945907102000, rc 0) 00000100:00100000:0.0:1790784439.447441:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:9681:x1877773344851584:12345-192.168.206.32@tcp:101:touch.500 Request processed in 17009us (17313us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784439.447449:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 21 00000100:00100000:0.0:1790784439.453194:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784439.453409:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344851840 00000100:00100000:1.0:1790784439.453418:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344851840 00000100:00100000:1.0:1790784439.453466:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 22 00000100:00100000:1.0:1790784439.453475:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:9681:x1877773344851840:12345-192.168.206.32@tcp:101:touch.500 00010000:00010000:1.0:1790784439.453493:0:9249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784439.453509:0:9249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d37f7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838134f8f expref: -99 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.453870:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d37fe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.453884:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d37fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.453894:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d37fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.455788:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3805 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.455808:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3805 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.455820:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3805 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790784439.457657:0:9249:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1790784439.458155:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d380c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.458235:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d380c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.458249:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d380c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.458286:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d37fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.458304:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d37fe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.458311:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d37fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.458317:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955f800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784439.458322:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d37fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.458330:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d37fe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.458341:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff945903a23e00) 00010000:00010000:1.0:1790784439.458344:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784439.458350:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d37fe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.458356:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d37fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790784439.458368:0:9249:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9750e18 reply state 00000000337db5b0 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3805 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784439.458513:0:9249:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790784439.458609:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d37f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f8f expref: 10 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.458628:0:9249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d380c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f8f expref: 9 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.458647:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94590345d200) 00010000:00010000:1.0:1790784439.458650:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790784439.458653:0:9249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945900031c00, rc 0) 00000100:00100000:1.0:1790784439.458762:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+10:9681:x1877773344851840:12345-192.168.206.32@tcp:101:touch.500 Request processed in 5287us (5575us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1790784439.458771:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 22 00010000:00010000:2.0:1790784439.462709:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3805 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.462725:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3805 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.462732:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3805 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.462738:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955f000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784439.462743:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3805 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.462751:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3805 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.462766:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x369fa11a (ffff94590345d500) 00010000:00010000:2.0:1790784439.462769:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784439.462774:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3805 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.462780:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3805 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784439.463762:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784439.463832:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344852096 00000100:00100000:2.0:1790784439.463841:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344852096 00000100:00100000:2.0:1790784439.463895:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 23 00000100:00100000:2.0:1790784439.463918:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+9:9681:x1877773344852096:12345-192.168.206.32@tcp:36:touch.500 00010000:00010000:2.0:1790784439.463993:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784439.464014:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d380c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f8f expref: 9 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.464029:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94590345d200) 00010000:00010000:2.0:1790784439.464036:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790784439.464079:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d381a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.464091:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d381a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.464101:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d381a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790784439.464217:0:5819:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd0d084a reply state 00000000150bb02c transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d381a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784439.464226:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790784439.464317:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+10:9681:x1877773344852096:12345-192.168.206.32@tcp:36:touch.500 Request processed in 400us (561us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1790784439.464324:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 23 00010000:00010000:3.0:1790784439.466457:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d381a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784439.466474:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d381a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784439.466482:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d381a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784439.466488:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75e00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784439.466493:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d381a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784439.466501:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d381a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784439.466515:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff945903af2a00) 00010000:00010000:3.0:1790784439.466518:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784439.466523:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d381a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784439.466530:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d381a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784439.470188:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784439.470268:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344852224 00000100:00100000:2.0:1790784439.470278:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344852224 00000100:00100000:2.0:1790784439.470337:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 24 00000100:00100000:2.0:1790784439.470346:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+9:9681:x1877773344852224:12345-192.168.206.32@tcp:101:touch.500 00010000:00010000:2.0:1790784439.470368:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784439.470428:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74600/0x2c3a1e2a079d3821 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838134f96 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.470511:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74600/0x2c3a1e2a079d3821 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f96 expref: 10 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.470526:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74600/0x2c3a1e2a079d3821 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f96 expref: 10 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.470553:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff945903af2200) 00010000:00010000:2.0:1790784439.470556:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790784439.470560:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74600, rc 0) 00000100:00100000:2.0:1790784439.470622:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+10:9681:x1877773344852224:12345-192.168.206.32@tcp:101:touch.500 Request processed in 277us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784439.470629:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 24 00000100:00100000:0.0:1790784439.474802:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784439.474898:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344852352 00000100:00100000:2.0:1790784439.474907:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344852352 00000100:00100000:2.0:1790784439.474981:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 16 00000100:00100000:2.0:1790784439.474989:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1877773344852352:12345-192.168.206.32@tcp:8:touch.500 00010000:00080000:2.0:1790784439.475023:0:6668:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from b0f9e8c2-ddb0-4027-babe-0b166585860c@192.168.206.32@tcp t0 exp 0000000000000000 cur 273 last 0 00000020:00000080:2.0:1790784439.475052:0:6668:0:(genops.c:1384:class_connect()) connect: client b0f9e8c2-ddb0-4027-babe-0b166585860c, cookie 0x2c3a1e2a079d3828 00002000:00100000:2.0:1790784439.475062:0:6668:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b0f9e8c2-ddb0-4027-babe-0b166585860c/ffff945935ef9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790784439.475084:0:6668:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790784439.475290:0:6668:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790784439.475318:0:6668:0:(import.c:65:import_set_state_nolock()) ffff94592c22b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790784439.475401:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2348:x1877773344852352:12345-192.168.206.32@tcp:8:touch.500 Request processed in 412us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784439.475426:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 16 00000100:00100000:3.0:1790784439.480470:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784439.480791:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344852480 00000100:00100000:2.0:1790784439.480800:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344852480 00000100:00100000:2.0:1790784439.480874:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 17 00000100:00100000:2.0:1790784439.480885:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d4c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:0:x1877773344852480:12345-192.168.206.32@tcp:2:touch.500 00000100:00080000:0.0:1790784439.481327:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1790784439.504346:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:0.0:1790784439.504361:0:7614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b0f9e8c2-ddb0-4027-babe-0b166585860c 00000100:00100000:3.0:1790784439.504806:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d4c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:0:x1877773344852480:12345-192.168.206.32@tcp:2:touch.500 Request processed in 23917us (24338us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1790784439.504830:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 17 00000100:00100000:0.0:1790784439.508228:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784439.508318:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344852736 00000100:00100000:2.0:1790784439.508328:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344852736 00000100:00100000:2.0:1790784439.508438:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 2 00000100:00100000:2.0:1790784439.508449:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d1e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+10:9681:x1877773344852736:12345-192.168.206.32@tcp:35:touch.500 00000100:00100000:2.0:1790784439.508762:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d1e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+11:9681:x1877773344852736:12345-192.168.206.32@tcp:35:touch.500 Request processed in 314us (540us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1790784439.508769:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 2 00000100:00100000:1.0:1790784439.522946:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784439.523089:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344852864 00000100:00100000:2.0:1790784439.523098:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344852864 00000100:00100000:0.0:1790784439.523342:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 25 00000100:00100000:0.0:1790784439.523355:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+11:9682:x1877773344852864:12345-192.168.206.32@tcp:101:rm.0 00010000:00010000:0.0:1790784439.523450:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784439.523483:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d382f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838134f9d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.523548:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945907102600/0x2c3a1e2a079d3836 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.523561:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945907102600/0x2c3a1e2a079d3836 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.523571:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945907102600/0x2c3a1e2a079d3836 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790784439.523602:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790784439.523605:0:5818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790784439.523641:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945907102600/0x2c3a1e2a079d3836 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.523666:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d382f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f9d expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.523683:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945907102600/0x2c3a1e2a079d3836 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f9d expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.523691:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff945903a23e00) 00010000:00010000:0.0:1790784439.523694:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790784439.523697:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945907102600, rc 0) 00000100:00100000:0.0:1790784439.523761:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+12:9682:x1877773344852864:12345-192.168.206.32@tcp:101:rm.0 Request processed in 410us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784439.523768:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 25 00000100:00100000:3.0:1790784439.527253:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784439.527795:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344853120 00000100:00100000:2.0:1790784439.527805:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344853120 00000100:00100000:2.0:1790784439.527863:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 26 00000100:00100000:2.0:1790784439.527873:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d4c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+12:9682:x1877773344853120:12345-192.168.206.32@tcp:101:rm.0 00010000:00010000:2.0:1790784439.527891:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784439.527909:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d383d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838134fa4 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784439.528005:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790784439.528163:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d383d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fa4 expref: 14 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.528186:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94590345dd00) 00010000:00010000:2.0:1790784439.528189:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790784439.528194:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d383d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fa4 expref: 14 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.528208:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe75800, rc 0) 00000100:00100000:2.0:1790784439.528266:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d4c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+13:9682:x1877773344853120:12345-192.168.206.32@tcp:101:rm.0 Request processed in 395us (1022us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1790784439.528274:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 26 00000100:00100000:2.0:1790784439.535286:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784439.535332:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344853248 00000100:00100000:0.0:1790784439.535354:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344853248 00000100:00100000:0.0:1790784439.535432:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 3 00000100:00100000:0.0:1790784439.535442:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+13:9682:x1877773344853248:12345-192.168.206.32@tcp:37:rm.0 00000100:00100000:0.0:1790784439.541895:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+13:9682:x1877773344853248:12345-192.168.206.32@tcp:37:rm.0 Request processed in 6444us (6607us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784439.541908:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 3 00000100:00100000:3.0:1790784439.557314:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784439.558153:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344853504 00000100:00100000:2.0:1790784439.558172:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344853504 00000100:00100000:2.0:1790784439.558229:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 4 00000100:00100000:2.0:1790784439.558238:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc16050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+13:9682:x1877773344853504:12345-192.168.206.32@tcp:35:rm.0 00000100:00100000:2.0:1790784439.558505:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc16050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+14:9682:x1877773344853504:12345-192.168.206.32@tcp:35:rm.0 Request processed in 267us (1199us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1790784439.558513:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 4 00000100:00100000:1.0:1790784439.571400:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784439.571587:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344853760 00000100:00100000:2.0:1790784439.571597:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344853760 00000100:00100000:2.0:1790784439.571700:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 27 00000100:00100000:2.0:1790784439.571711:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+14:9682:x1877773344853760:12345-192.168.206.32@tcp:101:rm.0 00010000:00010000:2.0:1790784439.571733:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784439.571753:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d384b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838134fab expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.571864:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d3852 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.571879:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d3852 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.571889:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d3852 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784439.571900:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790784439.572035:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d384b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fab expref: 17 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.572052:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d3852 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fab expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.572060:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff945903a23e00) 00010000:00010000:2.0:1790784439.572062:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790784439.572066:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74400, rc 0) 00000100:00100000:2.0:1790784439.572127:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+16:9682:x1877773344853760:12345-192.168.206.32@tcp:101:rm.0 Request processed in 418us (752us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1790784439.572134:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 27 00000100:00100000:3.0:1790784439.587128:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784439.587460:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344853888 00000100:00100000:1.0:1790784439.587469:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344853888 00000100:00100000:1.0:1790784439.587527:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 28 00000100:00100000:1.0:1790784439.587536:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d4c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+16:9682:x1877773344853888:12345-192.168.206.32@tcp:41:rm.0 00000004:00000024:1.0:1790784439.587588:0:9249:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1790784439.587658:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d4c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+16:9682:x1877773344853888:12345-192.168.206.32@tcp:41:rm.0 Request processed in 123us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784439.587665:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 28 00000100:00100000:3.0:1790784439.590092:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784439.592240:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344854016 00000100:00100000:0.0:1790784439.592256:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344854016 00000100:00100000:0.0:1790784439.592336:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 29 00000100:00100000:0.0:1790784439.592346:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+16:9682:x1877773344854016:12345-192.168.206.32@tcp:101:rm.0 00010000:00010000:0.0:1790784439.592365:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784439.592401:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945907102c00/0x2c3a1e2a079d3860 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838134fb2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.592913:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945907103800/0x2c3a1e2a079d3867 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.592940:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945907103800/0x2c3a1e2a079d3867 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.592952:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945907103800/0x2c3a1e2a079d3867 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.593043:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945907103e00/0x2c3a1e2a079d386e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.593053:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945907103e00/0x2c3a1e2a079d386e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.593060:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945907103e00/0x2c3a1e2a079d386e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.593235:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d3875 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.593245:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d3875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.593252:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d3875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790784439.593279:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1790784439.593561:0:5818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790784439.593584:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d3875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.593596:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d3875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.593604:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945907103800/0x2c3a1e2a079d3867 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.593611:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945907103800/0x2c3a1e2a079d3867 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.593618:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945907103800/0x2c3a1e2a079d3867 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.593624:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945907103800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784439.593629:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945907103800/0x2c3a1e2a079d3867 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.593636:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945907103800/0x2c3a1e2a079d3867 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.593654:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff945903a23e00) 00010000:00010000:0.0:1790784439.593658:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784439.593663:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945907103800/0x2c3a1e2a079d3867 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.593669:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945907103800/0x2c3a1e2a079d3867 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.593681:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945907103e00/0x2c3a1e2a079d386e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.593687:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945907103e00/0x2c3a1e2a079d386e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.593693:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945907103e00/0x2c3a1e2a079d386e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.593698:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945907103e00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784439.593701:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945907103e00/0x2c3a1e2a079d386e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.593707:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945907103e00/0x2c3a1e2a079d386e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.593713:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x369fa11a (ffff945903a23500) 00010000:00010000:0.0:1790784439.593716:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784439.593719:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945907103e00/0x2c3a1e2a079d386e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.593725:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945907103e00/0x2c3a1e2a079d386e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.593890:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945907102c00/0x2c3a1e2a079d3860 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fb2 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.593907:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d3875 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fb2 expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.593914:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff945903af2200) 00010000:00010000:0.0:1790784439.593916:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790784439.593919:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945907103c00, rc 0) 00000100:00100000:1.0:1790784439.598955:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+17:9682:x1877773344854016:12345-192.168.206.32@tcp:101:rm.0 Request processed in 6599us (8859us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784439.600052:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 29 00000100:00100000:0.0:1790784439.606089:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784439.610129:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344854272 00000100:00100000:1.0:1790784439.610143:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344854272 00000100:00100000:1.0:1790784439.610243:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 30 00000100:00100000:1.0:1790784439.610253:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d1e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+17:9682:x1877773344854272:12345-192.168.206.32@tcp:36:rm.0 00010000:00010000:1.0:1790784439.610317:0:9249:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790784439.610357:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d3875 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fb2 expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.610426:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74600/0x2c3a1e2a079d3821 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f96 expref: 16 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.610568:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff945903af2200) 00010000:00010000:1.0:1790784439.610587:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945907102600/0x2c3a1e2a079d3836 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f9d expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.610596:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff945903a23e00) 00010000:00010000:1.0:1790784439.610600:0:9249:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790784439.610620:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d387c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.610632:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d387c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.610642:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d387c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.610656:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d3883 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.610662:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d3883 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.610670:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d3883 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.611223:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031600/0x2c3a1e2a079d388a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.611239:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900031600/0x2c3a1e2a079d388a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.611248:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900031600/0x2c3a1e2a079d388a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790784439.612916:0:9249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1790784439.612937:0:9249:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 273762561537ns, next at 274762559112ns, rc = 0 00010000:00010000:1.0:1790784439.613583:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d3891 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.613598:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d3891 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.613609:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d3891 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.613617:0:9249:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d3891 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.613623:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d3891 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.613629:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d3891 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.613653:0:9249:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790784439.613671:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031600/0x2c3a1e2a079d388a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.613677:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900031600/0x2c3a1e2a079d388a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.613692:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945900031600/0x2c3a1e2a079d388a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.613697:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900031600 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784439.613701:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900031600/0x2c3a1e2a079d388a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.613709:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900031600/0x2c3a1e2a079d388a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.613719:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94590345d500) 00010000:00010000:1.0:1790784439.613722:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1790784439.613726:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945900031600/0x2c3a1e2a079d388a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.613733:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900031600/0x2c3a1e2a079d388a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.613750:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d387c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.613755:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d387c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.613815:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d387c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.613821:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784439.613824:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d387c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.613840:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d387c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.613848:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff945903a23e00) 00010000:00010000:1.0:1790784439.613851:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784439.613854:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d387c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784439.613860:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d387c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790784439.613870:0:9249:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000027464388 reply state 00000000f63ab0a7 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d3883 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784439.613878:0:9249:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790784439.614090:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d1e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+16:9682:x1877773344854272:12345-192.168.206.32@tcp:36:rm.0 Request processed in 3834us (8136us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1790784439.614098:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 30 00010000:00010000:3.0:1790784439.614516:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790784439.614523:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d3891 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784439.614530:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900031800 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:3.0:1790784439.614533:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d3891 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784439.614540:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d3891 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784439.614549:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94590345d500) 00010000:00010000:3.0:1790784439.614551:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790784439.614554:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d3891 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784439.614560:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d3891 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784439.614575:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784439.614576:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784439.614578:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784439.619462:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d3883 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.619480:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d3883 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.619488:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d3883 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.619508:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030c00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784439.619513:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d3883 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.619521:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d3883 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.619536:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x369fa11a (ffff94590345d200) 00010000:00010000:2.0:1790784439.619539:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784439.619544:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d3883 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.619551:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d3883 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784439.622339:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784439.622760:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344854528 00000100:00100000:2.0:1790784439.622777:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344854528 00000100:00100000:2.0:1790784439.622825:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 5 00000100:00100000:2.0:1790784439.622833:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d1e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+15:9682:x1877773344854528:12345-192.168.206.32@tcp:35:rm.0 00000100:00100000:2.0:1790784439.623120:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d1e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+16:9682:x1877773344854528:12345-192.168.206.32@tcp:35:rm.0 Request processed in 287us (788us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1790784439.623128:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 5 00000100:00100000:0.0:1790784439.633696:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784439.633889:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344854784 00000100:00100000:2.0:1790784439.633898:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344854784 00000100:00100000:2.0:1790784439.634090:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 31 00000100:00100000:2.0:1790784439.634102:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d1e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+16:9682:x1877773344854784:12345-192.168.206.32@tcp:36:rm.0 00010000:00010000:2.0:1790784439.634156:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790784439.634194:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d3852 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fab expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.634214:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945907102000/0x2c3a1e2a079d37f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f88 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.634225:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff945903a23e00) 00010000:00010000:2.0:1790784439.634240:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d37b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f7a expref: 14 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.634251:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94590345dd00) 00010000:00010000:2.0:1790784439.634258:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790784439.634512:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d3898 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.634526:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d3898 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.634536:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d3898 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.634550:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74600/0x2c3a1e2a079d389f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.634556:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74600/0x2c3a1e2a079d389f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.634562:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74600/0x2c3a1e2a079d389f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.634767:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d38a6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.634780:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d38a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.634788:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d38a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784439.635919:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790784439.635945:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d38a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.635953:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d38a6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.635969:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d38a6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.635974:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74e00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784439.635979:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d38a6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.635985:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d38a6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.635996:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff945903af2300) 00010000:00010000:2.0:1790784439.635998:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790784439.636002:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d38a6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.636007:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d38a6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.636027:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d3898 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.636039:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d3898 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.636044:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d3898 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.636049:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784439.636051:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d3898 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.636056:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d3898 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.636063:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2900) 00010000:00010000:2.0:1790784439.636065:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784439.636068:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d3898 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784439.636073:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d3898 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790784439.636083:0:5819:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004060ed7e reply state 0000000088ea0b95 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74600/0x2c3a1e2a079d389f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784439.636092:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790784439.636164:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d1e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+15:9682:x1877773344854784:12345-192.168.206.32@tcp:36:rm.0 Request processed in 2063us (2475us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1790784439.636172:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 31 00010000:00010000:0.0:1790784439.641416:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74600/0x2c3a1e2a079d389f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.641441:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74600/0x2c3a1e2a079d389f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.641450:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74600/0x2c3a1e2a079d389f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.641456:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74600 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784439.641461:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74600/0x2c3a1e2a079d389f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.641470:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74600/0x2c3a1e2a079d389f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.641487:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff945903af2000) 00010000:00010000:0.0:1790784439.641506:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784439.641513:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74600/0x2c3a1e2a079d389f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784439.641520:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74600/0x2c3a1e2a079d389f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784439.723189:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784439.723279:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784439.723365:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344854912 00000100:00100000:3.0:1790784439.723407:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344854912 00000100:00100000:3.0:1790784439.723467:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 248 00000100:00100000:3.0:1790784439.723490:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2352:x1877773344854912:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1790784439.723562:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2352:x1877773344854912:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 75us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784439.723569:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 248 00000100:00100000:2.0:1790784439.724053:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344855040 00000100:00100000:2.0:1790784439.724059:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344855040 00000100:00100000:2.0:1790784439.724121:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 98 00000100:00100000:2.0:1790784439.724129:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d1e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2352:x1877773344855040:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1790784439.724172:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d1e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2352:x1877773344855040:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 44us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784439.724178:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 98 00000100:00080000:3.0:1790784439.724401:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790784439.802917:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784440.826545:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784441.787281:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1877773359566464:0@lo:400:kworker.0 00000100:00100000:3.0:1790784441.787417:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784441.787484:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359566976:0@lo:400:kworker.0 00000100:00100000:3.0:1790784441.787514:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784441.787553:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1790784441.787560:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3280:1877773359566336:0@lo:400:kworker.0 00000100:00100000:3.0:1790784441.787594:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784441.787618:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3280:1877773359566848:0@lo:400:kworker.0 00000100:00100000:3.0:1790784441.787655:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784441.787698:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d1e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359566592:0@lo:400:kworker.0 00000100:00100000:3.0:1790784441.787731:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784441.787751:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790784441.787757:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359566720:0@lo:400:kworker.0 00000100:00100000:3.0:1790784441.787780:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784441.787818:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359566976 00000100:00100000:3.0:1790784441.787828:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359566976 00000100:00100000:3.0:1790784441.787892:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359566720 00000100:00100000:3.0:1790784441.787896:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359566720 00000100:00100000:3.0:1790784441.787935:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790784441.787956:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d4c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359566976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784441.788023:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d4c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359566976:12345-0@lo:400:kworker.0 Request processed in 80us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784441.788039:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790784441.788059:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790784441.788065:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fbb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359566720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784441.788097:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fbb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359566720:12345-0@lo:400:kworker.0 Request processed in 33us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784441.788103:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790784441.788123:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359566336 00000100:00100000:3.0:1790784441.788127:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359566336 00000100:00100000:3.0:1790784441.788153:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1790784441.788159:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905f9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3280:x1877773359566336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784441.788187:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905f9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3280:x1877773359566336:12345-0@lo:400:kworker.0 Request processed in 29us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784441.788194:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1790784441.788221:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359566464 00000100:00100000:3.0:1790784441.788225:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359566464 00000100:00100000:3.0:1790784441.788250:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359566848 00000100:00100000:3.0:1790784441.788253:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359566848 00000100:00100000:3.0:1790784441.788266:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359566592 00000100:00100000:3.0:1790784441.788269:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359566592 00000100:00100000:3.0:1790784441.788284:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790784441.788290:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d4c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1877773359566464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784441.788320:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d4c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1877773359566464:12345-0@lo:400:kworker.0 Request processed in 29us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784441.788325:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790784441.788336:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790784441.788342:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fbb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1877773359566848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784441.788410:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fbb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1877773359566848:12345-0@lo:400:kworker.0 Request processed in 66us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784441.788416:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790784441.788428:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790784441.788434:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fbb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1877773359566592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784441.788460:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fbb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1877773359566592:12345-0@lo:400:kworker.0 Request processed in 27us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784441.788466:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1790784441.788490:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790784441.788495:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790784441.788497:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1790784441.788545:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593d7f9500 x1877773359566720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784441.788561:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359566720:0@lo:400:kworker.0 00000100:00100000:3.0:1790784441.788573:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359566592:0@lo:400:kworker.0 00000100:00100000:3.0:1790784441.788604:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3280:1877773359566336:0@lo:400:kworker.0 00000100:00100000:3.0:1790784441.788614:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3280:1877773359566848:0@lo:400:kworker.0 00000100:00100000:3.0:1790784441.788624:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d1e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1877773359566464:0@lo:400:kworker.0 00010000:00080000:3.0:1790784441.788634:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593d7f8a80 x1877773359566976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784441.788643:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359566976:0@lo:400:kworker.0 00000100:00100000:2.0:1790784441.789207:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593fbb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359567104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790784441.789261:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784441.789402:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359567104 00000100:00100000:0.0:1790784441.789410:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359567104 00000100:00100000:0.0:1790784441.789454:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790784441.789462:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359567104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790784441.789500:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790784441.805727:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359567104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 16241us (16441us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784441.805745:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1790784441.805986:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593fbb9180 x1877773359567104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790784441.806021:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593fbb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359567104:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790784441.850811:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1790784442.300142:0:8113:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 276449763382ns, next at 277449760893ns, rc = 0 00000100:00100000:0.0:1790784442.300179:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359567232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790784442.300262:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784442.300347:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359567232 00000100:00100000:0.0:1790784442.300356:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359567232 00000100:00100000:0.0:1790784442.300449:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790784442.300460:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359567232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790784442.300503:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790784442.300559:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359567232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784442.300567:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1790784442.300639:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593d7fa680 x1877773359567232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784442.300661:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359567232:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790784442.874839:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790784443.534082:0:11589:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1790784443.898780:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1790784444.470757:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1790784444.470804:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:3.0:1790784444.470811:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1790784444.470819:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:3.0:1790784444.471108:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359567360:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1790784444.471202:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784444.471941:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359567360 00000100:00100000:2.0:1790784444.471954:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359567360 00000100:00100000:2.0:1790784444.472034:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790784444.472047:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fbb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359567360:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1790784444.472206:0:6668:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1790784444.472254:0:6668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6abd33b7, atime: 0x6abd33b7, ctime: 0x6abd33b7, blocks: 0x1 00010000:00010000:2.0:1790784444.472263:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5d608d2/0x2c3a1e2a079d38ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784444.472284:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=278s v=(0 0) 00010000:00010000:2.0:1790784444.472290:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790784444.472297:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5d608d2/0x2c3a1e2a079d38ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784444.472333:0:6668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5d608d2/0x2c3a1e2a079d38ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784444.472346:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5d608d2/0x2c3a1e2a079d38ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784444.472355:0:6668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5d608d2/0x2c3a1e2a079d38ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784444.472402:0:6668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1790784444.473489:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790784444.474045:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fbb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1877773359567360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1996us (2838us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1790784444.474058:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1790784444.474190:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790784444.474200:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5d608d2/0x2c3a1e2a079d38ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784444.474213:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75000 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:1.0:1790784444.474218:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5d608d2/0x2c3a1e2a079d38ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784444.474248:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5d608d2/0x2c3a1e2a079d38ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784444.474274:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5d608d2/0x2c3a1e2a079d38ad lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784444.474282:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5d608d2/0x2c3a1e2a079d38ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784444.474303:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784444.474305:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784444.474307:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1790784444.475668:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94590569fb80/2, rc 0, transno 4294967300 00000100:00100000:3.0:1790784444.475684:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359567360:0@lo:6:osp-syn-1-0.0 00000020:00000080:0.0:1790784444.793192:0:11637:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffcc80c190 20000000:00000080:0.0:1790784444.793210:0:11637:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94593f4acc00 uarg=0000000000000000 20000000:01000000:0.0:1790784444.793245:0:11637:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1790784444.793251:0:11637:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1790784444.793256:0:11637:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1790784444.794046:0:11638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1790784444.794183:0:11637:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1790784444.804722:0:11637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1790784444.804785:0:11637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1790784444.804847:0:11637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1790784444.804880:0:11637:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790784444.804913:0:11637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff945900031800/0x2c3a1e2a079d38b4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784444.805215:0:11637:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff945901524000/0x2c3a1e2a079d374f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f65 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784444.805225:0:11637:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff945907102800/0x2c3a1e2a079d3756 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f6c expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784444.805234:0:11637:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94590955f400/0x2c3a1e2a079d3764 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d375d expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784444.805252:0:11637:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94593fe75c00/0x2c3a1e2a079d3772 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d376b expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784444.805259:0:11637:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff945901525800/0x2c3a1e2a079d3780 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d3779 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784444.805265:0:11637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff945900031800/0x2c3a1e2a079d38b4 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784444.805315:0:11637:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff945901525800/0x2c3a1e2a079d3780 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d3779 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784444.805331:0:11637:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff945901525800/0x2c3a1e2a079d3780 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3779 expref: 18 pid: 5811 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784444.805347:0:11637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f4b4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11637:1877773359567488:0@lo:104: 00000100:00100000:1.0:1790784444.805530:0:11637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790784444.805648:0:11637:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94593fe75c00/0x2c3a1e2a079d3772 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d376b expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784444.805658:0:11637:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94593fe75c00/0x2c3a1e2a079d3772 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d376b expref: 18 pid: 5811 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784444.805666:0:11637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f4b6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11637:1877773359567616:0@lo:104: 00000100:00100000:1.0:1790784444.805687:0:11637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790784444.807837:0:11637:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94590955f400/0x2c3a1e2a079d3764 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d375d expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784444.807873:0:11637:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94590955f400/0x2c3a1e2a079d3764 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d375d expref: 18 pid: 5811 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784444.807920:0:11637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa54a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11637:1877773359567744:0@lo:104: 00000100:00100000:1.0:1790784444.808010:0:11637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784444.815859:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359567488 00000100:00100000:2.0:1790784444.815882:0:5800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359567488 00000100:00100000:3.0:1790784444.816064:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359567616 00000100:00100000:3.0:1790784444.816078:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359567616 00010000:00010000:1.0:1790784444.816182:0:11637:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff945907102800/0x2c3a1e2a079d3756 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f6c expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784444.816205:0:11637:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff945907102800/0x2c3a1e2a079d3756 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f6c expref: 12 pid: 5811 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784444.816222:0:11637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa57b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11637:1877773359567872:192.168.206.32@tcp:104: 00000100:00100000:3.0:1790784444.816279:0:5801:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1790784444.816336:0:11637:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff945901524000/0x2c3a1e2a079d374f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f65 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784444.816347:0:11637:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff945901524000/0x2c3a1e2a079d374f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f65 expref: 12 pid: 5810 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784444.816356:0:11637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa56d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11637:1877773359568000:192.168.206.32@tcp:104: 00000100:00100000:3.0:1790784444.816365:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359567744 00000100:00100000:3.0:1790784444.816372:0:5801:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359567744 00000100:00100000:1.0:1790784444.816426:0:11637:0:(client.c:2716:ptlrpc_set_wait()) set ffff945906616900 going to sleep for 11 seconds 00000100:00100000:3.0:1790784444.816440:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790784444.816451:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+5:11637:x1877773359567616:12345-0@lo:104: 00010000:00010000:3.0:1790784444.816469:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d376b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d3772 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784444.816572:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790784444.816578:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+5:11637:x1877773359567616:12345-0@lo:104: Request processed in 129us (10890us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784444.816585:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790784444.816603:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790784444.816609:0:5801:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907d24050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+4:11637:x1877773359567744:12345-0@lo:104: 00010000:00010000:3.0:1790784444.816617:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff945901525e00/0x2c3a1e2a079d375d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d3764 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784444.816656:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790784444.816675:0:5801:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907d24050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+4:11637:x1877773359567744:12345-0@lo:104: Request processed in 66us (8672us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784444.816682:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1790784444.816707:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790784444.816723:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d376b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d3772 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784444.816731:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901525a00 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:3.0:1790784444.816735:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d376b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d3772 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784444.816744:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d376b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d3772 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790784444.816752:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d376b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d3772 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790784444.816758:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790784444.816796:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d376b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3772 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784444.816802:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790784444.816821:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d376b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3772 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784444.816828:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff945901525a00/0x2c3a1e2a079d376b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3772 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784444.816843:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790784444.816847:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff945901525e00/0x2c3a1e2a079d375d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d3764 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784444.816946:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593fbba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3280:1877773359568128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790784444.817002:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790784444.817018:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901525e00 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:3.0:1790784444.817024:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff945901525e00/0x2c3a1e2a079d375d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d3764 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784444.817031:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff945901525e00/0x2c3a1e2a079d375d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d3764 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790784444.817037:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff945901525e00/0x2c3a1e2a079d375d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d3764 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790784444.817042:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1790784444.817058:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359568128 00000100:00100000:2.0:1790784444.817065:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359568128 00010000:00010000:2.0:1790784444.817096:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94593fe75c00/0x2c3a1e2a079d3772 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d376b expref: 19 pid: 5811 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784444.817130:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff945901525e00/0x2c3a1e2a079d375d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3764 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784444.817131:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790784444.817146:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3280:x1877773359568128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790784444.817162:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784444.817168:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94593fe75c00/0x2c3a1e2a079d3772 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d376b expref: 19 pid: 5811 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784444.817193:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94593fe75c00/0x2c3a1e2a079d3772 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d376b expref: 19 pid: 5811 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784444.817213:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790784444.817247:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3280:x1877773359568128:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784444.817259:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1790784444.817267:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790784444.817324:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593fbbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359568256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790784444.817339:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593fbba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3280:1877773359568128:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790784444.817371:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff945901525e00/0x2c3a1e2a079d375d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3764 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784444.817427:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff945901525e00/0x2c3a1e2a079d375d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3764 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784444.817439:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784444.817441:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784444.817443:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784444.817452:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784444.817517:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790784444.817531:0:5800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+3:11637:x1877773359567488:12345-0@lo:104: 00010000:00010000:3.0:1790784444.817542:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff945907102e00/0x2c3a1e2a079d3779 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d3780 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784444.817602:0:11637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94593fe75c00/0x2c3a1e2a079d3772 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d376b expref: 18 pid: 5811 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784444.817612:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790784444.817627:0:5800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+3:11637:x1877773359567488:12345-0@lo:104: Request processed in 95us (12092us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784444.817627:0:11637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f4b6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11637:1877773359567616:0@lo:104: 00000100:00100000:0.0:1790784444.817650:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784444.817657:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790784444.817665:0:11637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa54a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11637:1877773359567744:0@lo:104: 00000100:00100000:1.0:1790784444.817699:0:11637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f4b4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11637:1877773359567488:0@lo:104: 00000100:00100000:0.0:1790784444.817752:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359568256 00000100:00100000:0.0:1790784444.817760:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359568256 00010000:00010000:0.0:1790784444.817785:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94590955f400/0x2c3a1e2a079d3764 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d375d expref: 18 pid: 5811 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784444.817787:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790784444.817795:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff945907102e00/0x2c3a1e2a079d3779 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d3780 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784444.817803:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945907102e00 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:3.0:1790784444.817806:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff945907102e00/0x2c3a1e2a079d3779 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d3780 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784444.817815:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff945907102e00/0x2c3a1e2a079d3779 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d3780 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790784444.817822:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff945907102e00/0x2c3a1e2a079d3779 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d3780 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790784444.817827:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1790784444.817830:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790784444.817853:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:3281:x1877773359568256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790784444.817855:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff945907102e00/0x2c3a1e2a079d3779 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3780 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784444.817868:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784444.817876:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94590955f400/0x2c3a1e2a079d3764 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d375d expref: 18 pid: 5811 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784444.817888:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94590955f400/0x2c3a1e2a079d3764 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d375d expref: 18 pid: 5811 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784444.817914:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94590955f400/0x2c3a1e2a079d3764 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d375d expref: 18 pid: 5811 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784444.817938:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790784444.817947:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790784444.817964:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff945907102e00/0x2c3a1e2a079d3779 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3780 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784444.817972:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff945907102e00/0x2c3a1e2a079d3779 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d3780 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784444.817980:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:3281:x1877773359568256:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784444.817993:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:3.0:1790784444.818007:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784444.818011:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784444.818014:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784444.818039:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593fbbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359568256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790784444.818054:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790784444.818060:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593fbbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359568384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790784444.818085:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784444.818129:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359568384 00000100:00100000:3.0:1790784444.818134:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359568384 00010000:00010000:3.0:1790784444.818276:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff945901525800/0x2c3a1e2a079d3780 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3779 expref: 17 pid: 5811 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784444.818361:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790784444.818372:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905194450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:3281:x1877773359568384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790784444.818402:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784444.818408:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff945901525800/0x2c3a1e2a079d3780 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3779 expref: 17 pid: 5811 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784444.818417:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff945901525800/0x2c3a1e2a079d3780 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d3779 expref: 17 pid: 5811 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784444.818427:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945901525800/0x2c3a1e2a079d3780 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d3779 expref: 17 pid: 5811 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784444.818437:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790784444.818468:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905194450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:3281:x1877773359568384:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784444.818474:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790784444.821184:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593fbbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359568384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790784444.824862:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784444.824937:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784444.824994:0:11637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa57b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11637:1877773359567872:192.168.206.32@tcp:104: 00000100:00100000:0.0:1790784444.825028:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344855296 00000100:00100000:0.0:1790784444.825036:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344855296 00000100:00100000:3.0:1790784444.825038:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344855168 00000100:00100000:3.0:1790784444.825048:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344855168 00010000:00010000:0.0:1790784444.825088:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff945901524000/0x2c3a1e2a079d374f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f65 expref: 14 pid: 5810 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784444.825093:0:8421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff945907102800/0x2c3a1e2a079d3756 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f6c expref: 14 pid: 5811 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784444.825159:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 33 00000100:00100000:0.0:1790784444.825171:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+14:2351:x1877773344855296:12345-192.168.206.32@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790784444.825185:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 34 00010000:00010000:0.0:1790784444.825188:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784444.825198:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff945901524000/0x2c3a1e2a079d374f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f65 expref: 14 pid: 5810 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784444.825202:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d220700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+14:2351:x1877773344855168:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790784444.825226:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff945901524000/0x2c3a1e2a079d374f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f65 expref: 14 pid: 5810 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784444.825228:0:8421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784444.825242:0:8421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff945907102800/0x2c3a1e2a079d3756 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f6c expref: 14 pid: 5811 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784444.825268:0:8421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff945907102800/0x2c3a1e2a079d3756 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f6c expref: 14 pid: 5811 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784444.825846:0:11637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945901524000/0x2c3a1e2a079d374f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f65 expref: 14 pid: 5810 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784444.825874:0:11637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa56d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11637:1877773359568000:192.168.206.32@tcp:104: 00010000:00010000:0.0:1790784444.825927:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790784444.825947:0:11637:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff945900031800/0x2c3a1e2a079d38b4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784444.826060:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2351:x1877773344855296:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 888us (1208us total) trans 0 rc 0/0 00010000:00010000:3.0:1790784444.826069:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945907102800/0x2c3a1e2a079d3756 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f6c expref: 13 pid: 5811 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784444.826082:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 33 00010000:00010000:3.0:1790784444.826097:0:8421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff945900031800/0x2c3a1e2a079d38b4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784444.826109:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945900031800/0x2c3a1e2a079d38b4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784444.826129:0:8421:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff945900031800/0x2c3a1e2a079d38b4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784444.826137:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff945900031800/0x2c3a1e2a079d38b4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784444.826144:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff945900031800/0x2c3a1e2a079d38b4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784444.826152:0:8421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff945900031800/0x2c3a1e2a079d38b4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784444.826172:0:8421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900031800 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:3.0:1790784444.826177:0:8421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff945900031800/0x2c3a1e2a079d38b4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784444.826185:0:8421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff945900031800/0x2c3a1e2a079d38b4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784444.834094:0:11637:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff945900031800/0x2c3a1e2a079d38b4 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784444.834119:0:11637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff945900031800/0x2c3a1e2a079d38b4 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784444.837103:0:8421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff945900031800/0x2c3a1e2a079d38b4 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784444.837126:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945900031800/0x2c3a1e2a079d38b4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784444.837158:0:8421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790784444.837261:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d220700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+11:2351:x1877773344855168:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 12059us (12317us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784444.837275:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 34 00000100:00100000:1.0:1790784444.843111:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784444.843157:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784444.843201:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784444.843287:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344855424 00000100:00100000:2.0:1790784444.843300:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344855424 00000100:00100000:0.0:1790784444.843328:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344855680 00000100:00100000:0.0:1790784444.843343:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344855680 00000100:00100000:2.0:1790784444.843430:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 102 00000100:00100000:2.0:1790784444.843445:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2352:x1877773344855424:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1790784444.843552:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2352:x1877773344855424:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 111us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784444.843560:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 102 00000100:00100000:2.0:1790784444.843580:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 103 00000100:00100000:2.0:1790784444.843588:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2352:x1877773344855680:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1790784444.843614:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2352:x1877773344855680:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 27us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784444.843619:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 103 00000100:00100000:3.0:1790784444.843693:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344855552 00000100:00100000:3.0:1790784444.843700:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344855552 00000100:00100000:3.0:1790784444.843740:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 49 00000100:00100000:3.0:1790784444.843749:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2351:x1877773344855552:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1790784444.843779:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2351:x1877773344855552:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 33us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784444.843785:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 49 00000100:00080000:1.0:1790784444.843994:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790784444.844000:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790784444.933016:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790784444.963832:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:3.0:1790784445.948606:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790784446.523062:0:5815:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790784446.523074:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94593fa9a800 from 7 10000000:01000000:0.0:1790784446.523092:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790784446.523156:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945907103800/0x2c3a1e2a079d38bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784446.523171:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff945907103800/0x2c3a1e2a079d38bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784446.523185:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff945907103800/0x2c3a1e2a079d38bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784446.523219:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359568512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790784446.523312:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784446.523431:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592d511540 going to sleep for 11 seconds 00000100:00100000:2.0:1790784446.524134:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359568512 00000100:00100000:2.0:1790784446.524149:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359568512 00000100:00100000:2.0:1790784446.524230:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1790784446.524243:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905f9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:5815:x1877773359568512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790784446.524286:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784446.524308:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94593fe74a00/0x2c3a1e2a079d38c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d38bb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784446.524344:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94593fe74a00/0x2c3a1e2a079d38c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d38bb expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784446.524357:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94593fe74a00/0x2c3a1e2a079d38c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d38bb expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784446.524368:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74a00, rc 0) 00000100:00100000:2.0:1790784446.524495:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905f9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:5815:x1877773359568512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 255us (1183us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784446.524503:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1790784446.525157:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359568512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790784446.525185:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff945907103800/0x2c3a1e2a079d38bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d38c2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784446.525197:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff945907103800/0x2c3a1e2a079d38bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d38c2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784446.525306:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359568640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790784446.525395:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784446.525439:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592d511540 going to sleep for 11 seconds 00000100:00100000:3.0:1790784446.525564:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359568640 00000100:00100000:3.0:1790784446.525572:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359568640 00000100:00100000:3.0:1790784446.525619:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1790784446.525635:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:5815:x1877773359568640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790784446.525976:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:5815:x1877773359568640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 342us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784446.525985:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1790784446.526406:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359568640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790784446.526454:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359568768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790784446.526510:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784446.526550:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592d511540 going to sleep for 11 seconds 00000100:00100000:2.0:1790784446.526735:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359568768 00000100:00100000:2.0:1790784446.526741:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359568768 00000100:00100000:2.0:1790784446.526790:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1790784446.526798:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590564b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:5815:x1877773359568768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790784446.527030:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590564b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:5815:x1877773359568768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 232us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784446.527037:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1790784446.527151:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359568768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790784446.529475:0:11651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7fa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:11651:1877773359568896:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790784446.529585:0:11651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784446.529650:0:11651:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592d5119c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790784446.529775:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359568896 00000100:00100000:2.0:1790784446.529784:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359568896 00000100:00100000:2.0:1790784446.529838:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1790784446.529849:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:11651:x1877773359568896:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790784446.530140:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:11651:x1877773359568896:12345-0@lo:502:llog_process_th.0 Request processed in 291us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784446.530158:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1790784446.530739:0:11651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7fa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:11651:1877773359568896:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790784446.530777:0:11651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790784446.530789:0:11651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790784446.530792:0:11651:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790784446.530799:0:11651:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94593fa9a800 00000020:00000080:1.0:1790784446.530802:0:11651:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790784446.530918:0:11651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d221f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:11651:1877773359569024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790784446.530971:0:11651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784446.531010:0:11651:0:(client.c:2716:ptlrpc_set_wait()) set ffff945906616e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790784446.531214:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359569024 00000100:00100000:3.0:1790784446.531222:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359569024 00000100:00100000:3.0:1790784446.531287:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1790784446.531297:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905648450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:11651:x1877773359569024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790784446.531535:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905648450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:11651:x1877773359569024:12345-0@lo:502:llog_process_th.0 Request processed in 238us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784446.531543:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1790784446.532797:0:11651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d221f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:11651:1877773359569024:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790784446.532852:0:11651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790784446.532861:0:11651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790784446.532863:0:11651:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1790784446.532869:0:11651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1790784446.532964:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1790784446.532991:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790784446.533005:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945907103800/0x2c3a1e2a079d38bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d38c2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784446.533018:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff945907103800/0x2c3a1e2a079d38bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d38c2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790784446.533030:0:5815:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790784446.533033:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9459050db000 from 7 10000000:01000000:1.0:1790784446.533036:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790784446.533075:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d38c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784446.533085:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d38c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784446.533095:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d38c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784446.533116:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d221f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359569152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790784446.533181:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784446.533217:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff945906616e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790784446.533420:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359569152 00000100:00100000:0.0:1790784446.533429:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359569152 00000100:00100000:0.0:1790784446.533483:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1790784446.533494:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590564a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:5815:x1877773359569152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790784446.533512:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784446.533529:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945907102800/0x2c3a1e2a079d38d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d38c9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784446.533560:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945907102800/0x2c3a1e2a079d38d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d38c9 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784446.533573:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945907102800/0x2c3a1e2a079d38d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d38c9 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784446.533581:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945907102800, rc 0) 00000100:00100000:0.0:1790784446.533631:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590564a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:5815:x1877773359569152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784446.533639:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1790784446.533709:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d221f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359569152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790784446.533729:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d38c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d38d0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784446.533739:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d38c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d38d0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784446.533803:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359569280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790784446.533831:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784446.533846:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592d511900 going to sleep for 11 seconds 00000100:00100000:0.0:1790784446.533857:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359569280 00000100:00100000:0.0:1790784446.533861:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359569280 00000100:00100000:0.0:1790784446.533877:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1790784446.533883:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:5815:x1877773359569280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790784446.534189:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:5815:x1877773359569280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 304us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784446.534196:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1790784446.534228:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359569280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790784446.534273:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359569408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790784446.534314:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784446.534328:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592d511900 going to sleep for 11 seconds 00000100:00100000:0.0:1790784446.534341:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359569408 00000100:00100000:0.0:1790784446.534345:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359569408 00000100:00100000:0.0:1790784446.534365:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1790784446.534371:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:5815:x1877773359569408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790784446.534561:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:5815:x1877773359569408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 189us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784446.534575:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1790784446.534615:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359569408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790784446.534854:0:11652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7fb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:11652:1877773359569536:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790784446.534907:0:11652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784446.534930:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359569536 00000100:00100000:0.0:1790784446.534935:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359569536 00000100:00100000:0.0:1790784446.534956:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1790784446.534962:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:11652:x1877773359569536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790784446.535115:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:11652:x1877773359569536:12345-0@lo:502:llog_process_th.0 Request processed in 153us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784446.535122:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1790784446.535153:0:11652:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592d511840 going to sleep for 11 seconds 00000100:00100000:0.0:1790784446.535165:0:11652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7fb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:11652:1877773359569536:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790784446.535189:0:11652:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790784446.535201:0:11652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790784446.535203:0:11652:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790784446.535211:0:11652:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9459050db000 00000020:00000080:0.0:1790784446.535214:0:11652:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790784446.535288:0:11652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7fb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:11652:1877773359569664:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790784446.535323:0:11652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784446.535342:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359569664 00000100:00100000:0.0:1790784446.535347:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359569664 00000100:00100000:0.0:1790784446.535366:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1790784446.535371:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:11652:x1877773359569664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790784446.535506:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:11652:x1877773359569664:12345-0@lo:502:llog_process_th.0 Request processed in 134us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784446.535519:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1790784446.535546:0:11652:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592d511840 going to sleep for 11 seconds 00000100:00100000:0.0:1790784446.535557:0:11652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7fb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:11652:1877773359569664:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790784446.535572:0:11652:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790784446.535576:0:11652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790784446.535578:0:11652:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1790784446.535581:0:11652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1790784446.535637:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1790784446.535658:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790784446.535668:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d38c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d38d0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784446.535680:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d38c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d38d0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790784446.535693:0:5815:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790784446.535696:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff945905fd5000 from 7 10000000:01000000:0.0:1790784446.535699:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790784446.535726:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945907103e00/0x2c3a1e2a079d38d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784446.535734:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff945907103e00/0x2c3a1e2a079d38d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784446.535744:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff945907103e00/0x2c3a1e2a079d38d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784446.535758:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359569792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790784446.535786:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784446.535809:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459070680c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790784446.535822:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359569792 00000100:00100000:0.0:1790784446.535825:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359569792 00000100:00100000:0.0:1790784446.535849:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1790784446.535856:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:5815:x1877773359569792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790784446.535865:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784446.535877:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945907102e00/0x2c3a1e2a079d38de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d38d7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784446.535915:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945907102e00/0x2c3a1e2a079d38de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d38d7 expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784446.535927:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945907102e00/0x2c3a1e2a079d38de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d38d7 expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784446.535937:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945907102e00, rc 0) 00000100:00100000:0.0:1790784446.535966:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:5815:x1877773359569792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784446.535972:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1790784446.536003:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359569792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790784446.536016:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff945907103e00/0x2c3a1e2a079d38d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d38de expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784446.536025:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff945907103e00/0x2c3a1e2a079d38d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d38de expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784446.536066:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359569920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790784446.536090:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784446.536112:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459070680c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790784446.536123:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359569920 00000100:00100000:0.0:1790784446.536127:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359569920 00000100:00100000:0.0:1790784446.536146:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1790784446.536152:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:5815:x1877773359569920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790784446.540914:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:5815:x1877773359569920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4747us (4808us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784446.540932:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1790784446.545580:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359569920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790784446.545859:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d222a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359570048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790784446.545978:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784446.546126:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff945906616000 going to sleep for 11 seconds 00000100:00100000:0.0:1790784446.547787:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359570048 00000100:00100000:0.0:1790784446.547804:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359570048 00000100:00100000:0.0:1790784446.548008:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1790784446.548022:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:5815:x1877773359570048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790784446.548408:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:5815:x1877773359570048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 389us (2429us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784446.548416:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1790784446.548794:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d222a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:5815:1877773359570048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790784446.549548:0:11654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:11654:1877773359570176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790784446.549627:0:11654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784446.549676:0:11654:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459068be840 going to sleep for 11 seconds 00000100:00100000:2.0:1790784446.549714:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359570176 00000100:00100000:2.0:1790784446.549721:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359570176 00000100:00100000:2.0:1790784446.549761:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1790784446.549770:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:11654:x1877773359570176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790784446.550337:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:11654:x1877773359570176:12345-0@lo:502:llog_process_th.0 Request processed in 565us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784446.550347:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1790784446.550445:0:11654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:11654:1877773359570176:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790784446.550479:0:11654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790784446.550492:0:11654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784446.550495:0:11654:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790784446.550504:0:11654:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff945905fd5000 00000020:00000080:2.0:1790784446.550506:0:11654:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790784446.553389:0:11654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d223800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:11654:1877773359570304:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790784446.553502:0:11654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784446.554220:0:11654:0:(client.c:2716:ptlrpc_set_wait()) set ffff945906616240 going to sleep for 11 seconds 00000100:00100000:1.0:1790784446.554414:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359570304 00000100:00100000:1.0:1790784446.554425:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359570304 00000100:00100000:1.0:1790784446.554483:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1790784446.554493:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:11654:x1877773359570304:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790784446.555201:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:11654:x1877773359570304:12345-0@lo:502:llog_process_th.0 Request processed in 705us (1696us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784446.555212:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1790784446.555503:0:11654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d223800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:11654:1877773359570304:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790784446.555612:0:11654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790784446.555622:0:11654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790784446.555625:0:11654:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1790784446.555631:0:11654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1790784446.555931:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1790784446.555959:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790784446.555972:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945907103e00/0x2c3a1e2a079d38d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d38de expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784446.555984:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff945907103e00/0x2c3a1e2a079d38d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d38de expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790784446.581329:0:11656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790784446.763591:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784446.763688:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344855808 00000100:00100000:0.0:1790784446.763701:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344855808 00000100:00100000:0.0:1790784446.763784:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 265 00000100:00100000:0.0:1790784446.763795:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+11:5593:x1877773344855808:12345-192.168.206.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790784446.763817:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784446.763840:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945907102000/0x2c3a1e2a079d38e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x394e0d8838134fb9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784446.763876:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945907102000/0x2c3a1e2a079d38e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fb9 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784446.763899:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945907102000/0x2c3a1e2a079d38e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fb9 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784446.763935:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945907102000, rc 0) 00000100:00100000:0.0:1790784446.764013:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+12:5593:x1877773344855808:12345-192.168.206.32@tcp:101:ll_cfg_requeue.0 Request processed in 220us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784446.764021:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 265 00000100:00100000:0.0:1790784446.766494:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784446.770080:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344855936 00000100:00100000:1.0:1790784446.770103:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344855936 00000100:00100000:1.0:1790784446.770266:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 266 00000100:00100000:1.0:1790784446.770279:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+12:5593:x1877773344855936:12345-192.168.206.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790784446.770688:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+12:5593:x1877773344855936:12345-192.168.206.32@tcp:501:ll_cfg_requeue.0 Request processed in 408us (4309us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784446.770696:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 266 00000100:00100000:2.0:1790784446.780778:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784446.780916:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344856064 00000100:00100000:3.0:1790784446.780935:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344856064 00000100:00100000:3.0:1790784446.781008:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 267 00000100:00100000:3.0:1790784446.781021:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+12:5593:x1877773344856064:12345-192.168.206.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790784446.781326:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+12:5593:x1877773344856064:12345-192.168.206.32@tcp:503:ll_cfg_requeue.0 Request processed in 307us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784446.781334:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 267 00000100:00100000:2.0:1790784446.786199:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784446.786509:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344856192 00000100:00100000:3.0:1790784446.786522:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344856192 00000100:00100000:3.0:1790784446.786592:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 268 00000100:00100000:3.0:1790784446.786620:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+12:9952:x1877773344856192:12345-192.168.206.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790784446.786969:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+12:9952:x1877773344856192:12345-192.168.206.32@tcp:502:llog_process_th.0 Request processed in 352us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784446.786978:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 268 00000100:00100000:2.0:1790784446.791546:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784446.791771:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344856320 00000100:00100000:1.0:1790784446.791786:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344856320 00000100:00100000:1.0:1790784446.791858:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 269 00000100:00100000:1.0:1790784446.791870:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+12:9952:x1877773344856320:12345-192.168.206.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790784446.792460:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+12:9952:x1877773344856320:12345-192.168.206.32@tcp:502:llog_process_th.0 Request processed in 589us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784446.792470:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 269 00000100:00100000:2.0:1790784446.809697:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784446.810140:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344856448 00000100:00100000:0.0:1790784446.810155:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344856448 00000100:00100000:0.0:1790784446.810232:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 270 00000100:00100000:0.0:1790784446.810243:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+12:5593:x1877773344856448:12345-192.168.206.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790784446.810267:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784446.810290:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945907102c00/0x2c3a1e2a079d38ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x394e0d8838134fc0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784446.810325:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945907102c00/0x2c3a1e2a079d38ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fc0 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784446.810337:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945907102c00/0x2c3a1e2a079d38ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fc0 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784446.810347:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945907102c00, rc 0) 00000100:00100000:0.0:1790784446.810464:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:5593:x1877773344856448:12345-192.168.206.32@tcp:101:ll_cfg_requeue.0 Request processed in 223us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784446.810472:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 270 00000100:00100000:2.0:1790784446.824212:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784446.832949:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344856576 00000100:00100000:1.0:1790784446.832972:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344856576 00000100:00100000:1.0:1790784446.835154:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 271 00000100:00100000:1.0:1790784446.835175:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:5593:x1877773344856576:12345-192.168.206.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790784446.835951:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:5593:x1877773344856576:12345-192.168.206.32@tcp:501:ll_cfg_requeue.0 Request processed in 776us (11750us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784446.835963:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 271 00000100:00100000:1.0:1790784446.840180:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784446.840408:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344856704 00000100:00100000:3.0:1790784446.840422:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344856704 00000100:00100000:3.0:1790784446.840501:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 272 00000100:00100000:3.0:1790784446.840512:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:5593:x1877773344856704:12345-192.168.206.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790784446.841017:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:5593:x1877773344856704:12345-192.168.206.32@tcp:503:ll_cfg_requeue.0 Request processed in 504us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784446.841027:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 272 00000100:00100000:2.0:1790784446.849163:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784446.850867:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344856832 00000100:00100000:0.0:1790784446.851074:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344856832 00000100:00100000:0.0:1790784446.851419:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 273 00000100:00100000:0.0:1790784446.851448:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:9955:x1877773344856832:12345-192.168.206.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790784446.851813:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:9955:x1877773344856832:12345-192.168.206.32@tcp:502:llog_process_th.0 Request processed in 366us (2662us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784446.851822:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 273 00000100:00100000:2.0:1790784446.861536:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784446.861639:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344856960 00000100:00100000:3.0:1790784446.861652:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344856960 00000100:00100000:3.0:1790784446.861737:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 274 00000100:00100000:3.0:1790784446.861750:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:9955:x1877773344856960:12345-192.168.206.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790784446.862098:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:9955:x1877773344856960:12345-192.168.206.32@tcp:502:llog_process_th.0 Request processed in 349us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784446.862107:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 274 00000100:00100000:3.0:1790784446.907472:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790784446.907502:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593fbba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359570432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790784446.907592:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784446.908000:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359570432 00000100:00100000:0.0:1790784446.908012:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359570432 00000100:00100000:0.0:1790784446.908091:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790784446.908104:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fbbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359570432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790784446.908159:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1790784446.908453:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790784446.908589:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fbbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359570432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 488us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784446.908598:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1790784446.908726:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593fbba300 x1877773359570432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790784446.908750:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593fbba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359570432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790784446.915406:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790784446.915436:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1877773359570688:0@lo:400:kworker.0 00000100:00100000:0.0:1790784446.915540:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784446.915775:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790784446.915786:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359570816:0@lo:400:kworker.0 00000100:00100000:2.0:1790784446.915865:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3280:1877773359570560:0@lo:400:kworker.0 00000100:00100000:3.0:1790784446.915985:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359570688 00000100:00100000:3.0:1790784446.916005:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359570688 00000100:00100000:3.0:1790784446.916069:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790784446.916080:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1877773359570688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784446.916546:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1877773359570944:0@lo:400:kworker.0 00000100:00100000:1.0:1790784446.919827:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784446.920145:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359570816 00000100:00100000:1.0:1790784446.920158:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359570816 00000100:00100000:1.0:1790784446.920369:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790784446.920408:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1877773359570816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784446.920656:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1877773359570816:12345-0@lo:400:kworker.0 Request processed in 253us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784446.920664:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790784446.920724:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359570816:0@lo:400:kworker.0 00000100:00100000:2.0:1790784446.920870:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790784446.921129:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790784446.921416:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359570560 00000100:00100000:1.0:1790784446.921423:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359570560 00000100:00100000:2.0:1790784446.921634:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359571072:0@lo:400:kworker.0 00000100:00100000:2.0:1790784446.921689:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784446.921820:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1790784446.921830:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3280:x1877773359570560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784446.921903:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3280:x1877773359570560:12345-0@lo:400:kworker.0 Request processed in 74us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784446.921910:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1790784446.922193:0:8181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359571072 00000100:00100000:3.0:1790784446.922198:0:8181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359571072 00000100:00100000:3.0:1790784446.922270:0:8181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790784446.922279:0:8181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359571072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784446.922322:0:8181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359571072:12345-0@lo:400:kworker.0 Request processed in 45us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784446.922329:0:8181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790784446.922390:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1877773359570688:12345-0@lo:400:kworker.0 Request processed in 6311us (6850us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784446.922398:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790784446.922455:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1877773359570688:0@lo:400:kworker.0 00000100:00100000:2.0:1790784446.922898:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1790784446.922906:0:3280:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94590569fb80, transno 4294967300 00000100:00100000:2.0:1790784446.922925:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359571072:0@lo:400:kworker.0 00000100:00100000:2.0:1790784446.922938:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3280:1877773359570560:0@lo:400:kworker.0 00000100:00080000:1.0:1790784446.925038:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790784446.928085:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784446.933045:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359570944 00000100:00100000:2.0:1790784446.933069:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359570944 00000100:00100000:2.0:1790784446.933198:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790784446.933211:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1877773359570944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784446.933365:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1877773359570944:12345-0@lo:400:kworker.0 Request processed in 157us (5291us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784446.933394:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790784446.933831:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1877773359570944:0@lo:400:kworker.0 00000100:00080000:1.0:1790784446.934154:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790784446.970473:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784447.419163:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790784447.419206:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359571200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790784447.419300:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784447.419874:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359571200 00000100:00100000:0.0:1790784447.419896:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359571200 00000100:00100000:0.0:1790784447.419980:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790784447.419993:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fbb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359571200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790784447.420044:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790784447.420122:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fbb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359571200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784447.420148:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790784447.420537:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359571200:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1790784447.612492:0:11656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790784447.998917:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784449.018577:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784449.964509:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784449.964619:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784449.964664:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784449.964712:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784449.965350:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344857344 00000100:00100000:3.0:1790784449.965365:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344857344 00000100:00100000:2.0:1790784449.965474:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344857216 00000100:00100000:2.0:1790784449.965499:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344857216 00000100:00100000:2.0:1790784449.965579:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344857472 00000100:00100000:2.0:1790784449.965582:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344857472 00000100:00100000:2.0:1790784449.965612:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 107 00000100:00100000:2.0:1790784449.965622:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2349:x1877773344857216:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1790784449.965729:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2349:x1877773344857216:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 107us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784449.965737:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 107 00000100:00100000:2.0:1790784449.965758:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 108 00000100:00100000:2.0:1790784449.965764:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2349:x1877773344857472:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1790784449.965790:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2349:x1877773344857472:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 26us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784449.965796:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 108 00000100:00100000:3.0:1790784449.966714:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 51 00000100:00100000:3.0:1790784449.966727:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2349:x1877773344857344:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1790784449.967027:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2349:x1877773344857344:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 60us (2165us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784449.967035:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 51 00000100:00080000:2.0:1790784449.967371:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790784449.967398:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790784449.969635:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344857088 00000100:00100000:1.0:1790784449.969656:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344857088 00000100:00100000:1.0:1790784449.969760:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 276 00000100:00100000:1.0:1790784449.969774:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2349:x1877773344857088:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784449.969891:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2349:x1877773344857088:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 120us (5397us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784449.969900:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 276 00010000:00010000:3.0:1790784450.046411:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784451.066618:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784452.026721:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3280:1877773359571584:0@lo:400:kworker.0 00000100:00100000:2.0:1790784452.026819:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784452.026921:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790784452.026929:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1877773359571456:0@lo:400:kworker.0 00000100:00100000:2.0:1790784452.026964:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784452.026983:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359571968:0@lo:400:kworker.0 00000100:00100000:2.0:1790784452.027013:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784452.027047:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359571584 00000100:00100000:2.0:1790784452.027057:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359571584 00000100:00100000:2.0:1790784452.027114:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359571456 00000100:00100000:2.0:1790784452.027118:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359571456 00000100:00100000:2.0:1790784452.027144:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790784452.027188:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906a71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1877773359571584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784452.027253:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906a71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1877773359571584:12345-0@lo:400:kworker.0 Request processed in 68us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784452.027261:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790784452.027280:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790784452.027287:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906a73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1877773359571456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784452.027330:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906a73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1877773359571456:12345-0@lo:400:kworker.0 Request processed in 44us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784452.027337:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1790784452.027360:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790784452.027429:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1877773359571456:0@lo:400:kworker.0 00000100:00100000:2.0:1790784452.027457:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3280:1877773359571584:0@lo:400:kworker.0 00000100:00100000:1.0:1790784452.027581:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359571712:0@lo:400:kworker.0 00000100:00100000:1.0:1790784452.027617:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784452.027667:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790784452.027674:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359571328:0@lo:400:kworker.0 00000100:00100000:1.0:1790784452.027704:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784452.027729:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1877773359571840:0@lo:400:kworker.0 00000100:00100000:1.0:1790784452.027751:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784452.027777:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359571840 00000100:00100000:1.0:1790784452.027781:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359571840 00000100:00100000:1.0:1790784452.027827:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790784452.027842:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1877773359571840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784452.027895:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1877773359571840:12345-0@lo:400:kworker.0 Request processed in 54us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784452.027902:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:1.0:1790784452.027920:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790784452.027938:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1877773359571840:0@lo:400:kworker.0 00000100:00100000:1.0:1790784452.027959:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359571328 00000100:00100000:1.0:1790784452.027962:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359571328 00000100:00100000:1.0:1790784452.027988:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1790784452.027995:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3281:x1877773359571328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784452.028030:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3281:x1877773359571328:12345-0@lo:400:kworker.0 Request processed in 36us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784452.028036:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1790784452.028074:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359571328:0@lo:400:kworker.0 00000100:00100000:3.0:1790784452.028235:0:8181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359571968 00000100:00100000:3.0:1790784452.028246:0:8181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359571968 00000100:00100000:3.0:1790784452.028284:0:8181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359571712 00000100:00100000:3.0:1790784452.028287:0:8181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359571712 00000100:00100000:3.0:1790784452.028311:0:8181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790784452.028318:0:8181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359571968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784452.028359:0:8181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359571968:12345-0@lo:400:kworker.0 Request processed in 42us (1344us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784452.028366:0:8181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790784452.028409:0:8181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790784452.028416:0:8181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359571712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784452.028451:0:8181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359571712:12345-0@lo:400:kworker.0 Request processed in 36us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784452.028457:0:8181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1790784452.028477:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790784452.028480:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1790784452.028502:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593d7e5180 x1877773359571712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784452.028519:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359571712:0@lo:400:kworker.0 00000100:00100000:1.0:1790784452.028588:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593fbbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359572096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790784452.028618:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784452.028658:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359571968:0@lo:400:kworker.0 00000100:00100000:3.0:1790784452.028719:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359572096 00000100:00100000:3.0:1790784452.028723:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359572096 00000100:00100000:3.0:1790784452.028759:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790784452.028767:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359572096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790784452.028799:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790784452.028840:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359572096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784452.028853:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1790784452.028889:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593fbbaa00 x1877773359572096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784468 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784452.028914:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593fbbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359572096:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790784452.090667:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790784452.539441:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790784452.539476:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359572224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790784452.539572:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784452.539746:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359572224 00000100:00100000:0.0:1790784452.539756:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359572224 00000100:00100000:0.0:1790784452.539824:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790784452.539836:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359572224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790784452.540194:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790784452.540333:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359572224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 498us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784452.540342:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790784452.541331:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359572224:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790784453.121936:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784454.138741:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784455.092329:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784455.093631:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344857600 00000100:00100000:1.0:1790784455.093651:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344857600 00000100:00100000:1.0:1790784455.093740:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 278 00000100:00100000:1.0:1790784455.093753:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2349:x1877773344857600:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784455.094254:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2349:x1877773344857600:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 501us (1937us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784455.094262:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 278 00000100:00100000:3.0:1790784455.095005:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784455.095050:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784455.095086:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784455.095237:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344857728 00000100:00100000:1.0:1790784455.095246:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344857728 00000100:00100000:1.0:1790784455.095314:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344857984 00000100:00100000:1.0:1790784455.095318:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344857984 00000100:00100000:1.0:1790784455.095340:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 112 00000100:00100000:1.0:1790784455.095349:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fbb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2349:x1877773344857728:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784455.095445:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fbb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2349:x1877773344857728:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 97us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784455.095454:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 112 00000100:00100000:1.0:1790784455.095473:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 113 00000100:00100000:1.0:1790784455.095479:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fbbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2349:x1877773344857984:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784455.095505:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fbbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2349:x1877773344857984:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 26us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784455.095511:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 113 00000100:00100000:0.0:1790784455.095850:0:8181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344857856 00000100:00100000:0.0:1790784455.095857:0:8181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344857856 00000100:00100000:0.0:1790784455.095910:0:8181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 54 00000100:00100000:0.0:1790784455.095921:0:8181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fbbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2349:x1877773344857856:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:0.0:1790784455.095973:0:8181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fbbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2349:x1877773344857856:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 55us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784455.095980:0:8181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 54 00000100:00080000:3.0:1790784455.096144:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790784455.096149:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790784455.162694:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784456.188553:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790784457.151883:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790784457.151914:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593fbb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359572352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790784457.151989:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784457.152282:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359572352 00000100:00100000:3.0:1790784457.152292:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359572352 00000100:00100000:3.0:1790784457.152370:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790784457.152410:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359572480:0@lo:400:kworker.0 00000100:00100000:3.0:1790784457.152411:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359572352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790784457.152453:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790784457.152459:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784457.152488:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359572992:0@lo:400:kworker.0 00000100:00100000:3.0:1790784457.152516:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359572352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784457.152523:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784457.152531:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790784457.152560:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1877773359572608:0@lo:400:kworker.0 00000100:00100000:0.0:1790784457.152574:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359572480 00000100:00100000:0.0:1790784457.152591:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359572480 00000100:00100000:3.0:1790784457.152595:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784457.152630:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1790784457.152638:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359572992 00000100:00100000:0.0:1790784457.152639:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3279:x1877773359572480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784457.152644:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359572992 00000100:00100000:0.0:1790784457.152685:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3279:x1877773359572480:12345-0@lo:400:kworker.0 Request processed in 46us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784457.152688:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790784457.152698:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1790784457.152701:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359572992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784457.152748:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359572480:0@lo:400:kworker.0 00000100:00100000:1.0:1790784457.152786:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359572736:0@lo:400:kworker.0 00000100:00080000:2.0:1790784457.152849:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790784457.152853:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790784457.152873:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1877773359572864:0@lo:400:kworker.0 00000100:00100000:3.0:1790784457.153031:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359572992:12345-0@lo:400:kworker.0 Request processed in 333us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784457.153038:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790784457.153067:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359572608 00000100:00100000:3.0:1790784457.153071:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359572608 00000100:00100000:3.0:1790784457.153100:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790784457.153108:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fbb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1877773359572608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784457.153154:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fbb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1877773359572608:12345-0@lo:400:kworker.0 Request processed in 46us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784457.153161:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790784457.153197:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1877773359572608:0@lo:400:kworker.0 00000100:00100000:3.0:1790784457.153225:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359572992:0@lo:400:kworker.0 00000100:00100000:2.0:1790784457.160649:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784457.160747:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359572864 00000100:00100000:3.0:1790784457.160765:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359572864 00000100:00100000:1.0:1790784457.160915:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00080000:2.0:1790784457.160979:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790784457.161005:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1877773359572864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784457.161078:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1877773359572864:12345-0@lo:400:kworker.0 Request processed in 84us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784457.161099:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1790784457.161217:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1877773359572864:0@lo:400:kworker.0 00000100:00100000:0.0:1790784457.161346:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1790784457.161532:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593fbb8000 x1877773359572352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784473 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784457.161562:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593fbb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359572352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790784457.164498:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359572736 00000100:00100000:3.0:1790784457.164644:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359572736 00000100:00100000:3.0:1790784457.164882:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1790784457.164896:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1877773359572736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784457.165035:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1877773359572736:12345-0@lo:400:kworker.0 Request processed in 143us (3689us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784457.165042:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:2.0:1790784457.165075:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790784457.165271:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359572736:0@lo:400:kworker.0 00010000:00010000:0.0:1790784457.210661:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784457.660268:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359573120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790784457.660361:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784457.661147:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359573120 00000100:00100000:0.0:1790784457.661159:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359573120 00000100:00100000:0.0:1790784457.661232:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790784457.661245:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fbbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359573120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790784457.661295:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790784457.661401:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fbbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359573120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 158us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784457.661409:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790784457.661541:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359573120:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1790784457.851106:0:11656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790784458.234629:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784459.258786:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784460.209433:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784460.209507:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784460.209613:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344858112 00000100:00100000:1.0:1790784460.209627:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344858112 00000100:00100000:1.0:1790784460.209699:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 280 00000100:00100000:1.0:1790784460.209711:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459036db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2352:x1877773344858112:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784460.209807:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459036db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2352:x1877773344858112:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 98us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784460.209825:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 280 00000100:00100000:2.0:1790784460.211524:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344858240 00000100:00100000:2.0:1790784460.211545:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344858240 00000100:00100000:2.0:1790784460.211664:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 117 00000100:00100000:2.0:1790784460.211677:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fbb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2351:x1877773344858240:12345-192.168.206.32@tcp:400:kworker.0 00000100:00080000:3.0:1790784460.212038:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790784460.217077:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fbb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2351:x1877773344858240:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 5383us (7548us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784460.217097:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 117 00000100:00100000:3.0:1790784460.219938:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784460.220132:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784460.220248:0:8181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344858368 00000100:00100000:1.0:1790784460.220263:0:8181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344858368 00000100:00100000:2.0:1790784460.220312:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344858496 00000100:00100000:2.0:1790784460.220316:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344858496 00000100:00100000:2.0:1790784460.220351:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 118 00000100:00100000:1.0:1790784460.220351:0:8181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 19 00000100:00100000:2.0:1790784460.220362:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fbba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2351:x1877773344858496:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784460.220362:0:8181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fbb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2348:x1877773344858368:12345-192.168.206.32@tcp:9:kworker.0 00000020:00000080:1.0:1790784460.220412:0:8181:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d3828 00000100:00080000:1.0:1790784460.220423:0:8181:0:(import.c:65:import_set_state_nolock()) ffff94592c22b000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1790784460.220460:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fbba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2351:x1877773344858496:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 100us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784460.220468:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 118 00000001:00000004:1.0:1790784460.220481:0:8181:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1790784460.220771:0:8181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fbb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+2:2348:x1877773344858368:12345-192.168.206.32@tcp:9:kworker.0 Request processed in 410us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784460.220779:0:8181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 19 00010000:00010000:1.0:1790784460.220840:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790784460.221422:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790784460.221445:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1790784460.282743:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790784460.341010:0:7614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b0f9e8c2-ddb0-4027-babe-0b166585860c 00000020:00000080:1.0:1790784460.341023:0:7614:0:(genops.c:885:class_export_put()) final put ffff945935ef9800/b0f9e8c2-ddb0-4027-babe-0b166585860c 00000020:00000080:0.0:1790784460.341124:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff945935ef9800/b0f9e8c2-ddb0-4027-babe-0b166585860c for lustre-OST0001 00000020:00000080:0.0:1790784460.341195:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94592c22b000 for lustre-OST0001 00010000:00010000:1.0:1790784461.307663:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784462.268783:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593fbba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359573504:0@lo:400:kworker.0 00000100:00100000:2.0:1790784462.268801:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593fbbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1877773359573376:0@lo:400:kworker.0 00000100:00100000:0.0:1790784462.268936:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593fbbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359573248:0@lo:400:kworker.0 00000100:00100000:1.0:1790784462.269094:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593fbb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359573632:0@lo:400:kworker.0 00000100:00100000:2.0:1790784462.277411:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784462.277677:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f4b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359573888:0@lo:400:kworker.0 00000100:00100000:2.0:1790784462.277729:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784462.278157:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359573888 00000100:00100000:2.0:1790784462.278165:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359573888 00000100:00100000:2.0:1790784462.278216:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790784462.278225:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359573888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784462.278279:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359573888:12345-0@lo:400:kworker.0 Request processed in 55us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784462.278286:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790784462.278322:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f4b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359573888:0@lo:400:kworker.0 00000100:00080000:2.0:1790784462.278348:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790784462.278518:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359573376 00000100:00100000:2.0:1790784462.278523:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359573376 00000100:00100000:2.0:1790784462.278699:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1790784462.278754:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1877773359573376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784462.278794:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1877773359573376:12345-0@lo:400:kworker.0 Request processed in 43us (1389us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784462.278801:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1790784462.278845:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593fbbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1877773359573376:0@lo:400:kworker.0 00000100:00100000:0.0:1790784462.284616:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784462.284686:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359573248 00000100:00100000:0.0:1790784462.284702:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d4c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1877773359573760:0@lo:400:kworker.0 00000100:00100000:2.0:1790784462.284711:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359573248 00000100:00100000:0.0:1790784462.284756:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784462.284790:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1790784462.284802:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3281:x1877773359573248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784462.284918:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903697450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3281:x1877773359573248:12345-0@lo:400:kworker.0 Request processed in 106us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784462.284926:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1790784462.284981:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359573760 00000100:00100000:2.0:1790784462.284986:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359573760 00000100:00100000:2.0:1790784462.285027:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1790784462.285034:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1877773359573760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784462.285081:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1877773359573760:12345-0@lo:400:kworker.0 Request processed in 48us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784462.285087:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1790784462.285110:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790784462.285136:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784462.285167:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359573504 00000100:00100000:2.0:1790784462.285172:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359573504 00000100:00100000:3.0:1790784462.285187:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359574016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790784462.285211:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1790784462.285221:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359573504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784462.285232:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784462.285307:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593fbba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359573504:0@lo:400:kworker.0 00000100:00080000:3.0:1790784462.285347:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790784462.286297:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593fbbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359573248:0@lo:400:kworker.0 00000100:00100000:0.0:1790784462.286316:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d4c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1877773359573760:0@lo:400:kworker.0 00000100:00100000:3.0:1790784462.286727:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359574016 00000100:00100000:3.0:1790784462.286735:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359574016 00000100:00100000:3.0:1790784462.286872:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790784462.286884:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359574016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790784462.286935:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790784462.287015:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359574016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (1784us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784462.287023:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1790784462.287072:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593d7e7800 x1877773359574016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784462.287313:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359574016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790784462.287362:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359573504:12345-0@lo:400:kworker.0 Request processed in 2132us (2216us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784462.287432:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1790784462.288092:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790784462.290675:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784462.290834:0:8181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359573632 00000100:00100000:0.0:1790784462.290852:0:8181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359573632 00000100:00100000:0.0:1790784462.290935:0:8181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790784462.290948:0:8181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359573632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784462.291063:0:8181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359573632:12345-0@lo:400:kworker.0 Request processed in 118us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784462.291072:0:8181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1790784462.291113:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593fbb9180 x1877773359573632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790784462.291129:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593fbb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359573632:0@lo:400:kworker.0 00010000:00010000:0.0:1790784462.331327:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790784462.779766:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359574144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790784462.779874:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784462.780026:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359574144 00000100:00100000:0.0:1790784462.780038:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359574144 00000100:00100000:0.0:1790784462.780112:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790784462.780123:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359574144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790784462.780168:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790784462.780234:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359574144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784462.780242:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790784462.780427:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359574144:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790784463.355038:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784464.378904:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784465.328239:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784465.328292:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784465.328331:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784465.329941:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344858880 00000100:00100000:2.0:1790784465.329959:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344858880 00000100:00100000:2.0:1790784465.330037:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344858752 00000100:00100000:2.0:1790784465.330040:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344858752 00000100:00100000:2.0:1790784465.330068:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 122 00000100:00100000:2.0:1790784465.330078:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2349:x1877773344858880:12345-192.168.206.32@tcp:400:kworker.0 00000100:00080000:3.0:1790784465.330144:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790784465.330187:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 123 00000100:00100000:2.0:1790784465.330193:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2349:x1877773344858880:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 113us (1897us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784465.330205:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2349:x1877773344858752:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1790784465.330205:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 122 00000100:00100000:3.0:1790784465.330247:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2349:x1877773344858752:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 48us (1913us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784465.330273:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 123 00000100:00100000:0.0:1790784465.332762:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344858624 00000100:00100000:0.0:1790784465.332785:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344858624 00000100:00100000:0.0:1790784465.332923:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 282 00000100:00100000:0.0:1790784465.332937:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2349:x1877773344858624:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:0.0:1790784465.333422:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2349:x1877773344858624:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 485us (5195us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784465.333432:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 282 00010000:00010000:1.0:1790784465.402637:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784466.450200:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790784467.069631:0:11656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790784467.387364:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790784467.387400:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359574272:0@lo:400:kworker.0 00000100:00100000:2.0:1790784467.387458:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784467.387508:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359574272 00000100:00100000:2.0:1790784467.387514:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359574272 00000100:00100000:2.0:1790784467.387549:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1790784467.387557:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3282:x1877773359574272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784467.387595:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903695050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3282:x1877773359574272:12345-0@lo:400:kworker.0 Request processed in 39us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784467.387602:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1790784467.387640:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359574272:0@lo:400:kworker.0 00000100:00100000:2.0:1790784467.387673:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790784467.387679:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3280:1877773359574528:0@lo:400:kworker.0 00000100:00100000:2.0:1790784467.387701:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784467.387734:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359574528 00000100:00100000:2.0:1790784467.387737:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359574528 00000100:00100000:2.0:1790784467.387763:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1790784467.387769:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fbb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1877773359574528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784467.387814:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fbb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1877773359574528:12345-0@lo:400:kworker.0 Request processed in 45us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784467.387821:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1790784467.387847:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3280:1877773359574528:0@lo:400:kworker.0 00000100:00100000:2.0:1790784467.387860:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1877773359574400:0@lo:400:kworker.0 00000100:00100000:2.0:1790784467.387879:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784467.387922:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593fbba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359574656:0@lo:400:kworker.0 00000100:00100000:2.0:1790784467.387942:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784467.387962:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359574656 00000100:00100000:2.0:1790784467.387965:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359574656 00000100:00100000:2.0:1790784467.387995:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790784467.388002:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359574656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784467.388026:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593fbbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1877773359574784:0@lo:400:kworker.0 00000100:00100000:2.0:1790784467.388033:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359574656:12345-0@lo:400:kworker.0 Request processed in 32us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784467.388039:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790784467.388066:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1790784467.388066:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593fbba680 x1877773359574656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790784483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790784467.388076:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593fbba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359574656:0@lo:400:kworker.0 00000100:00100000:3.0:1790784467.388084:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790784467.388089:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359574912:0@lo:400:kworker.0 00000100:00100000:3.0:1790784467.388110:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790784467.388142:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790784467.388146:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790784467.388159:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359574400 00000100:00100000:3.0:1790784467.388163:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359574400 00000100:00100000:3.0:1790784467.388188:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359574784 00000100:00100000:3.0:1790784467.388191:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359574784 00000100:00100000:2.0:1790784467.388196:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359574912 00000100:00100000:2.0:1790784467.388200:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359574912 00000100:00100000:3.0:1790784467.388212:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1790784467.388218:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fbbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1877773359574400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784467.388221:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790784467.388226:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359574912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784467.388254:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fbbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1877773359574400:12345-0@lo:400:kworker.0 Request processed in 35us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784467.388260:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1790784467.388264:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359574912:12345-0@lo:400:kworker.0 Request processed in 39us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784467.388270:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790784467.388275:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1790784467.388282:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1877773359574784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784467.388311:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790784467.388316:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1877773359574784:12345-0@lo:400:kworker.0 Request processed in 33us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784467.388324:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359575040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790784467.388325:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:3.0:1790784467.388341:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790784467.388343:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790784467.388358:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359574912:0@lo:400:kworker.0 00000100:00100000:3.0:1790784467.388396:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593fbbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1877773359574784:0@lo:400:kworker.0 00000100:00100000:3.0:1790784467.388435:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1877773359574400:0@lo:400:kworker.0 00000100:00100000:1.0:1790784467.388442:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784467.388545:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359575040 00000100:00100000:2.0:1790784467.388549:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359575040 00000100:00100000:2.0:1790784467.388580:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790784467.388587:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359575040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790784467.388608:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790784467.388639:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359575040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784467.388645:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1790784467.388871:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593d7e7800 x1877773359575040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790784467.388887:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359575040:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790784467.456608:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790784467.906025:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790784467.906055:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359575168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790784467.906144:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784467.915297:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359575168 00000100:00100000:2.0:1790784467.915317:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359575168 00000100:00100000:2.0:1790784467.915446:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790784467.915459:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359575168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790784467.915511:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790784467.915625:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359575168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 168us (9480us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784467.915633:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790784467.915699:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359575168:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790784468.475114:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784469.499597:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790784469.506829:0:11819:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 12:07:47 (1790784467) 00000100:00100000:3.0:1790784470.443737:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784470.443802:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784470.443852:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784470.444130:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344859008 00000100:00100000:0.0:1790784470.444144:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344859008 00000100:00100000:0.0:1790784470.444221:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 284 00000100:00100000:0.0:1790784470.444233:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2350:x1877773344859008:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:0.0:1790784470.444327:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903694050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2350:x1877773344859008:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 96us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784470.444335:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 284 00000100:00100000:2.0:1790784470.444368:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344859264 00000100:00100000:2.0:1790784470.444412:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344859264 00000100:00100000:2.0:1790784470.444593:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344859136 00000100:00100000:2.0:1790784470.444597:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344859136 00000100:00100000:2.0:1790784470.444626:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 127 00000100:00100000:2.0:1790784470.444634:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d1e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2350:x1877773344859264:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1790784470.444694:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d1e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2350:x1877773344859264:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 61us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784470.444701:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 127 00000100:00100000:2.0:1790784470.444716:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 128 00000100:00100000:2.0:1790784470.444722:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d1e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2350:x1877773344859136:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1790784470.444746:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d1e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2350:x1877773344859136:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 24us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784470.444752:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 128 00000100:00080000:2.0:1790784470.444779:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790784470.522912:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784471.492788:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784471.492989:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344859392 00000100:00100000:2.0:1790784471.493002:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344859392 00000100:00100000:2.0:1790784471.493081:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 32 00000100:00100000:2.0:1790784471.493094:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:10222:x1877773344859392:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790784471.493122:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784471.493153:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d38f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838134fc7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.493248:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d38fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.493266:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d38fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.493282:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d38fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784471.493329:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790784471.493349:0:5818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790784471.493435:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d38fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.493466:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d38f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fc7 expref: 7 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.493488:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d38fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fc7 expref: 6 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.493496:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2900) 00010000:00010000:2.0:1790784471.493500:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790784471.493504:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe75000, rc 0) 00000100:00100000:2.0:1790784471.493589:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:10222:x1877773344859392:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 498us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784471.493597:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 32 00000100:00100000:0.0:1790784471.511853:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784471.515576:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344859520 00000100:00100000:2.0:1790784471.515597:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344859520 00000100:00100000:2.0:1790784471.515689:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 33 00000100:00100000:2.0:1790784471.515701:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:10223:x1877773344859520:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790784471.515727:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784471.515982:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3901 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838134fce expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.516072:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3908 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.516337:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3908 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.516401:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3908 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.516494:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d390f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.516503:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d390f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.516510:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d390f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.516954:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d3916 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.516965:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d3916 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.516973:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d3916 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784471.517011:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790784471.517015:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790784471.517037:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d3916 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.517049:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3908 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.517057:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3908 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.517870:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3908 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.517955:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74200 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784471.517961:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3908 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.517970:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3908 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.517987:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2900) 00010000:00010000:2.0:1790784471.517990:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784471.517996:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3908 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.518004:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3908 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.518025:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d390f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.518031:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d390f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.518038:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d390f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.518044:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74c00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784471.518047:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d390f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.518068:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d390f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.518299:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff945903af2300) 00010000:00010000:2.0:1790784471.518303:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784471.518308:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d390f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.518314:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d390f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.518368:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3901 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fce expref: 8 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.518963:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d3916 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fce expref: 7 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.518972:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff945903af2f00) 00010000:00010000:2.0:1790784471.518975:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790784471.518977:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe75c00, rc 0) 00000100:00100000:2.0:1790784471.519594:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:10223:x1877773344859520:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 3891us (7750us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784471.519605:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 33 00000100:00100000:0.0:1790784471.540332:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784471.540608:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344859776 00000100:00100000:2.0:1790784471.540620:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344859776 00000100:00100000:2.0:1790784471.540694:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 34 00000100:00100000:2.0:1790784471.540707:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:10223:x1877773344859776:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790784471.540755:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784471.540793:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d391d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838134fd5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.540911:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3924 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.540930:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3924 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784471.542324:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3924 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784471.549801:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784471.549977:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d392b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784471.550004:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d392b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784471.550021:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d392b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784471.551044:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525800/0x2c3a1e2a079d3932 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784471.551065:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901525800/0x2c3a1e2a079d3932 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784471.551240:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525800/0x2c3a1e2a079d3932 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790784471.551260:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1790784471.552014:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3924 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784471.552040:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3924 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784471.552047:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3924 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784471.552053:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74c00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784471.552058:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3924 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784471.552066:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3924 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784471.552619:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff945903af2f00) 00010000:00010000:3.0:1790784471.552626:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784471.552635:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3924 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784471.552644:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3924 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784471.552666:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d392b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784471.552673:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d392b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784471.552680:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d392b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784471.552686:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901525e00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784471.552701:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d392b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784471.552708:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d392b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784471.552719:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff94592012a500) 00010000:00010000:3.0:1790784471.552722:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784471.552725:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d392b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784471.552732:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d392b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784471.554194:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d391d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fd5 expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784471.554227:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525800/0x2c3a1e2a079d3932 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fd5 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784471.554237:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94592012a400) 00010000:00010000:3.0:1790784471.554240:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784471.554244:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945901525800, rc 0) 00000100:00100000:3.0:1790784471.554344:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+9:10223:x1877773344859776:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 13638us (14025us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1790784471.554354:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 34 00000100:00100000:1.0:1790784471.569454:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784471.570130:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344859904 00000100:00100000:2.0:1790784471.570145:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344859904 00000100:00100000:2.0:1790784471.570223:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 35 00000100:00100000:2.0:1790784471.570235:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+9:10223:x1877773344859904:12345-192.168.206.32@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1790784471.570428:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+9:10223:x1877773344859904:12345-192.168.206.32@tcp:59:lhsmtool_posix.0 Request processed in 195us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784471.570437:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 35 00000040:00080000:2.0:1790784472.192457:0:11656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790784472.515458:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359575296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790784472.515566:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784472.515750:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359575296 00000100:00100000:0.0:1790784472.515770:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359575296 00000100:00100000:0.0:1790784472.515844:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790784472.515855:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359575296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790784472.515911:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790784472.516097:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359575296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 244us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784472.516106:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790784472.518860:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593fe4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1877773359575552:0@lo:400:kworker.0 00000100:00100000:1.0:1790784472.518963:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784472.519012:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790784472.519018:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593fe4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359575680:0@lo:400:kworker.0 00000100:00100000:1.0:1790784472.519044:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790784472.519126:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790784472.519174:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593fe4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1877773359575808:0@lo:400:kworker.0 00000100:00100000:1.0:1790784472.519215:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1790784472.519263:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94593d7e7800 x1877773359575296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790784472.519293:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359575296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790784472.519314:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790784472.519319:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593fe4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359575424:0@lo:400:kworker.0 00000100:00100000:1.0:1790784472.519351:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784472.519413:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593fe4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359575936:0@lo:400:kworker.0 00000100:00100000:1.0:1790784472.519442:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784472.519475:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359575552 00000100:00100000:1.0:1790784472.519482:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359575552 00000100:00100000:1.0:1790784472.519532:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359575680 00000100:00100000:1.0:1790784472.519535:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359575680 00000100:00100000:1.0:1790784472.519559:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359575808 00000100:00100000:1.0:1790784472.519562:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359575808 00000100:00100000:1.0:1790784472.519580:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1790784472.519589:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fe4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1877773359575552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784472.519646:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fe4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1877773359575552:12345-0@lo:400:kworker.0 Request processed in 57us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784472.519654:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1790784472.519673:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1790784472.519679:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fe4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359575680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784472.519708:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fe4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359575680:12345-0@lo:400:kworker.0 Request processed in 29us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784472.519713:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1790784472.519726:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1790784472.519741:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fe4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1877773359575808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784472.519787:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fe4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1877773359575808:12345-0@lo:400:kworker.0 Request processed in 47us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784472.519793:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1790784472.519814:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359575424 00000100:00100000:1.0:1790784472.519817:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359575424 00000100:00100000:1.0:1790784472.519844:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1790784472.519851:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3281:x1877773359575424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784472.519881:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3281:x1877773359575424:12345-0@lo:400:kworker.0 Request processed in 31us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784472.519886:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1790784472.519914:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359575936 00000100:00100000:1.0:1790784472.519918:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359575936 00000100:00100000:1.0:1790784472.519948:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790784472.519955:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fe4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359575936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784472.519983:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fe4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359575936:12345-0@lo:400:kworker.0 Request processed in 29us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784472.519988:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1790784472.520006:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790784472.520010:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790784472.520028:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593fe4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359575424:0@lo:400:kworker.0 00000100:00100000:1.0:1790784472.520039:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593fe4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359575936:0@lo:400:kworker.0 00000100:00100000:1.0:1790784472.520047:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593fe4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1877773359575808:0@lo:400:kworker.0 00000100:00100000:1.0:1790784472.520077:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593fe4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359575680:0@lo:400:kworker.0 00000100:00100000:1.0:1790784472.520087:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593fe4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1877773359575552:0@lo:400:kworker.0 00010000:00010000:3.0:1790784472.573199:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784473.019056:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593fbbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359576064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790784473.019151:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784473.019242:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359576064 00000100:00100000:2.0:1790784473.019251:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359576064 00000100:00100000:2.0:1790784473.019303:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790784473.019312:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fbba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359576064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790784473.019353:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790784473.019436:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fbba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359576064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784473.019443:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790784473.019493:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593fbbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359576064:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790784473.594602:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790784474.065336:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784474.065491:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344860032 00000100:00100000:2.0:1790784474.065506:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344860032 00000100:00100000:2.0:1790784474.065587:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 36 00000100:00100000:2.0:1790784474.065614:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fe4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+9:10266:x1877773344860032:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:2.0:1790784474.065644:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784474.065674:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3940 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838134fdc expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.065777:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d3947 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.065795:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d3947 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.065811:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d3947 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.065828:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d394e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.065835:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d394e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.066091:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d394e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.066371:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d3947 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.066413:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d3947 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.066420:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d3947 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.066426:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75600 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784474.066431:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d3947 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.066439:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d3947 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.066453:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2900) 00010000:00010000:2.0:1790784474.066456:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784474.066462:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d3947 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.066469:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d3947 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.066483:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d394e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.066489:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d394e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.066494:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d394e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.066506:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784474.066509:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d394e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.066516:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d394e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.066524:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff945903af2300) 00010000:00010000:2.0:1790784474.066527:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784474.066529:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d394e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.066535:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d394e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.066587:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3940 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fdc expref: 10 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.066991:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2900) 00010000:00010000:2.0:1790784474.066995:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784474.067001:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3940 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fdc expref: 10 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.067014:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74800, rc 0) 00000100:00100000:2.0:1790784474.067109:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fe4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+9:10266:x1877773344860032:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 1512us (1788us total) trans 0 rc 301/301 00000100:00100000:2.0:1790784474.067119:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 36 00000100:00080000:1.0:1790784474.067250:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790784474.075189:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784474.075774:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344860288 00000100:00100000:2.0:1790784474.075807:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344860288 00000100:00100000:2.0:1790784474.075890:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 37 00000100:00100000:2.0:1790784474.075903:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+9:10266:x1877773344860288:12345-192.168.206.32@tcp:36:lfs.0 00010000:00010000:2.0:1790784474.075993:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784474.076030:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d38fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fc7 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.076055:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2900) 00010000:00010000:2.0:1790784474.076070:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790784474.076360:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d3955 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.076401:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d3955 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.076413:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d3955 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.076428:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d395c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.076435:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d395c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.076441:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d395c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784474.077508:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1790784474.077526:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d3955 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.077536:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d3955 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.077552:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d3955 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.077560:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75e00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784474.077565:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d3955 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.077574:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d3955 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.077590:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2000) 00010000:00010000:2.0:1790784474.077593:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784474.077598:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d3955 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.077622:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d3955 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790784474.077645:0:5818:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c8cf86a reply state 00000000a33df1f2 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d395c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784474.077656:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790784474.077824:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+10:10266:x1877773344860288:12345-192.168.206.32@tcp:36:lfs.0 Request processed in 1919us (2643us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1790784474.077836:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 37 00010000:00010000:0.0:1790784474.089739:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d395c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784474.089770:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d395c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784474.089780:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d395c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784474.089787:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784474.089793:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d395c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784474.089801:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d395c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784474.089820:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff945903af2200) 00010000:00010000:0.0:1790784474.089824:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784474.089829:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d395c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784474.089836:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d395c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784474.143837:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784474.144052:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344860416 00000100:00100000:2.0:1790784474.144066:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344860416 00000100:00100000:2.0:1790784474.144156:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 38 00000100:00100000:2.0:1790784474.144170:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fe4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+9:10274:x1877773344860416:12345-192.168.206.32@tcp:101:lctl.0 00010000:00010000:2.0:1790784474.144233:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784474.144261:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d3963 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838134fe3 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.144346:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d396a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.144364:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d396a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.144408:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d396a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784474.144456:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790784474.144460:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790784474.144507:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d396a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.144538:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d3963 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fe3 expref: 11 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.144559:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d396a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fe3 expref: 10 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.144569:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2000) 00010000:00010000:2.0:1790784474.144572:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790784474.144576:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe75000, rc 0) 00000100:00100000:2.0:1790784474.144658:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fe4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+10:10274:x1877773344860416:12345-192.168.206.32@tcp:101:lctl.0 Request processed in 491us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784474.144665:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 38 00000100:00100000:0.0:1790784474.213597:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784474.223529:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344860544 00000100:00100000:2.0:1790784474.223550:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344860544 00000100:00100000:2.0:1790784474.223732:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 39 00000100:00100000:2.0:1790784474.223755:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+10:10280:x1877773344860544:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:2.0:1790784474.224724:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784474.224768:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3971 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838134fea expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.225307:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d3978 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.225326:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d3978 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.225340:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d3978 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.225357:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d397f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.225364:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d397f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.225371:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d397f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.225525:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74600/0x2c3a1e2a079d3986 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.225534:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74600/0x2c3a1e2a079d3986 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.225572:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74600/0x2c3a1e2a079d3986 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784474.227484:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1790784474.227497:0:5818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790784474.227571:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74600/0x2c3a1e2a079d3986 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.227596:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d3978 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.227616:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d3978 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.227625:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d3978 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.227631:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75600 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784474.227637:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d3978 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.227646:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d3978 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.227666:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2000) 00010000:00010000:2.0:1790784474.227670:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784474.227676:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d3978 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.227683:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d3978 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.227716:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d397f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.227724:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d397f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.227730:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d397f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.227736:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784474.227739:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d397f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.227755:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d397f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.227763:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff945903af2900) 00010000:00010000:2.0:1790784474.227765:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784474.227768:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d397f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.227774:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d397f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.227854:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3971 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fea expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.227873:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74600/0x2c3a1e2a079d3986 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fea expref: 11 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.227894:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff945903af2300) 00010000:00010000:2.0:1790784474.227897:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790784474.227899:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74600, rc 0) 00000100:00100000:2.0:1790784474.228801:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+11:10280:x1877773344860544:12345-192.168.206.32@tcp:101:bash.0 Request processed in 5048us (15204us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784474.228815:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 39 00000100:00100000:2.0:1790784474.237484:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784474.237528:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344860800 00000100:00100000:2.0:1790784474.237544:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344860800 00000100:00100000:2.0:1790784474.237622:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 40 00000100:00100000:2.0:1790784474.237634:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fbbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+11:10280:x1877773344860800:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:2.0:1790784474.237661:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784474.237689:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d398d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838134ff1 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.237898:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3994 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.237929:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3994 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.237945:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3994 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.238139:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d399b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.238162:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d399b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.238192:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d399b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790784474.238798:0:5819:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1790784474.238955:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d39a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.238965:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d39a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.238974:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d39a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.239006:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3994 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.239013:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3994 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.239020:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3994 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.239027:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784474.239031:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3994 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.239038:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3994 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.239049:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff945903af2300) 00010000:00010000:2.0:1790784474.239052:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784474.239063:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3994 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.239070:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3994 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790784474.239084:0:5819:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000866b8718 reply state 000000007510ef04 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d399b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784474.239092:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790784474.239124:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d398d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134ff1 expref: 14 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.239138:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d39a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134ff1 expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.239145:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff945903af2b00) 00010000:00010000:2.0:1790784474.239148:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790784474.239150:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74e00, rc 0) 00000100:00100000:2.0:1790784474.239221:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fbbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+14:10280:x1877773344860800:12345-192.168.206.32@tcp:101:bash.0 Request processed in 1590us (1753us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1790784474.239230:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 40 00010000:00010000:3.0:1790784474.246046:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d399b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.246065:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d399b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.246073:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d399b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.246079:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784474.246084:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d399b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.246092:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d399b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.246109:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff945903af2a00) 00010000:00010000:3.0:1790784474.246112:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784474.246117:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d399b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.246124:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d399b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784474.247854:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784474.247929:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344860928 00000100:00100000:0.0:1790784474.247938:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344860928 00000100:00100000:0.0:1790784474.247991:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 20 00000100:00100000:0.0:1790784474.248000:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1877773344860928:12345-192.168.206.32@tcp:8:bash.0 00010000:00080000:0.0:1790784474.248031:0:6669:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from b0f9e8c2-ddb0-4027-babe-0b166585860c@192.168.206.32@tcp t0 exp 0000000000000000 cur 308 last 0 00000020:00000080:0.0:1790784474.248062:0:6669:0:(genops.c:1384:class_connect()) connect: client b0f9e8c2-ddb0-4027-babe-0b166585860c, cookie 0x2c3a1e2a079d39b0 00002000:00100000:0.0:1790784474.248083:0:6669:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b0f9e8c2-ddb0-4027-babe-0b166585860c/ffff94590364b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790784474.248118:0:6669:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790784474.248427:0:6669:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790784474.248466:0:6669:0:(import.c:65:import_set_state_nolock()) ffff94590364c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790784474.248550:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2348:x1877773344860928:12345-192.168.206.32@tcp:8:bash.0 Request processed in 548us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784474.248560:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 20 00000100:00100000:2.0:1790784474.256416:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784474.256691:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344861056 00000100:00100000:1.0:1790784474.256708:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344861056 00000100:00100000:1.0:1790784474.256847:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 21 00000100:00100000:1.0:1790784474.256869:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:0:x1877773344861056:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:1.0:1790784474.256897:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784474.256930:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d39b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838134ff8 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790784474.256969:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790784474.256996:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=308s v=(0 0) 00010000:00010000:1.0:1790784474.257002:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784474.257016:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d39b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134ff8 expref: 7 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784474.257042:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d39b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134ff8 expref: 7 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784474.257058:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945900030c00, rc 0) 00000100:00100000:1.0:1790784474.257140:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:0:x1877773344861056:12345-192.168.206.32@tcp:101:bash.0 Request processed in 281us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784474.257148:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 21 00000100:00080000:2.0:1790784474.257399:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790784474.261508:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784474.261592:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344861184 00000100:00100000:0.0:1790784474.261602:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344861184 00000100:00100000:0.0:1790784474.261659:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 22 00000100:00100000:0.0:1790784474.261670:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:10280:x1877773344861184:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:0.0:1790784474.261686:0:6669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784474.261705:0:6669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096bfeb68/0x2c3a1e2a079d39be lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838134fff expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784474.261733:0:6669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d39b7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134ff8 expref: 8 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784474.261754:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790784474.261759:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790784474.261765:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096bfeb68/0x2c3a1e2a079d39be lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fff expref: 8 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784474.261807:0:6669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d39b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134ff8 expref: 8 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784474.261839:0:6669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d39b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134ff8 expref: 8 pid: 6670 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784474.261853:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6669:1877773359576192:192.168.206.32@tcp:104: 00000100:00100000:0.0:1790784474.261945:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593fe4a840 going to sleep for 11 seconds 00000100:00100000:1.0:1790784474.266642:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784474.266739:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6669:1877773359576192:192.168.206.32@tcp:104: 00010000:00010000:0.0:1790784474.266791:0:6669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000096bfeb68/0x2c3a1e2a079d39be lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fff expref: 8 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784474.266812:0:6669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945907102600, rc 0) 00000100:00100000:0.0:1790784474.266863:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:10280:x1877773344861184:12345-192.168.206.32@tcp:101:bash.0 Request processed in 5196us (5364us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784474.266871:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 22 00000100:00100000:3.0:1790784474.266995:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344861312 00000100:00100000:3.0:1790784474.267002:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344861312 00010000:00010000:3.0:1790784474.267031:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d39b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134ff8 expref: 8 pid: 6670 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784474.267064:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 35 00000100:00100000:3.0:1790784474.267079:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fe4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:2351:x1877773344861312:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790784474.267092:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784474.267122:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d39b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134ff8 expref: 8 pid: 6670 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.267135:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d39b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134ff8 expref: 8 pid: 6670 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.267159:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d39b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134ff8 expref: 8 pid: 6670 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.267173:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784474.267178:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784474.267185:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000096bfeb68/0x2c3a1e2a079d39be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fff expref: 7 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.267196:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096bfeb68/0x2c3a1e2a079d39be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fff expref: 7 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.267225:0:5802:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000096bfeb68/0x2c3a1e2a079d39be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fff expref: 7 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784474.267239:0:5802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945907df4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5802:1877773359576320:192.168.206.32@tcp:105: 00000100:00100000:3.0:1790784474.267286:0:5802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459068be9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790784474.271306:0:5802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945907df4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5802:1877773359576320:192.168.206.32@tcp:105: 00010000:00010000:3.0:1790784474.271347:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790784474.271433:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fe4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2351:x1877773344861312:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 4353us (4798us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784474.271444:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 35 00000100:00100000:2.0:1790784474.274436:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784474.274483:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344861568 00000100:00100000:3.0:1790784474.274492:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344861568 00000100:00100000:3.0:1790784474.274540:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 6 00000100:00100000:3.0:1790784474.274550:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+13:10280:x1877773344861568:12345-192.168.206.32@tcp:35:bash.0 00000100:00100000:3.0:1790784474.274874:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+14:10280:x1877773344861568:12345-192.168.206.32@tcp:35:bash.0 Request processed in 325us (447us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1790784474.274882:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 6 00000100:00100000:1.0:1790784474.368531:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784474.369865:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344861824 00000100:00100000:3.0:1790784474.369877:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344861824 00000100:00100000:2.0:1790784474.370273:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 41 00000100:00100000:2.0:1790784474.370294:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fe4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+14:10290:x1877773344861824:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:2.0:1790784474.370337:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784474.370368:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d39c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135006 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784474.370561:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1790784474.370848:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d39c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135006 expref: 16 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.370864:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2000) 00010000:00010000:2.0:1790784474.370867:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790784474.370873:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d39c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135006 expref: 16 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.370887:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74000, rc 0) 00000100:00100000:2.0:1790784474.370986:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fe4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+15:10290:x1877773344861824:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 695us (2455us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1790784474.371003:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 41 00000100:00100000:3.0:1790784474.374365:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784474.374495:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344862080 00000100:00100000:1.0:1790784474.374504:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344862080 00000100:00100000:1.0:1790784474.374566:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 7 00000100:00100000:1.0:1790784474.374577:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+15:10290:x1877773344862080:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:1.0:1790784474.374821:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+16:10290:x1877773344862080:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 246us (465us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1790784474.374829:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 7 00000100:00100000:3.0:1790784474.493233:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784474.493342:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344862208 00000100:00100000:2.0:1790784474.493351:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344862208 00000100:00100000:3.0:1790784474.493636:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 42 00000100:00100000:3.0:1790784474.493647:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+16:10296:x1877773344862208:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:3.0:1790784474.493670:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784474.493691:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d39d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813500d expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.493767:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d39da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.493782:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d39da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.493793:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d39da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790784474.493933:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1790784474.493936:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790784474.493957:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d39da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.493983:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d39d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813500d expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.494005:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d39da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813500d expref: 17 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.494013:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff945903af2300) 00010000:00010000:3.0:1790784474.494016:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790784474.494021:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945901525e00, rc 0) 00000100:00100000:3.0:1790784474.494115:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+17:10296:x1877773344862208:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 470us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784474.494121:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 42 00000100:00100000:1.0:1790784474.498859:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784474.499576:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344862464 00000100:00100000:0.0:1790784474.499586:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344862464 00000100:00100000:0.0:1790784474.499642:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 43 00000100:00100000:0.0:1790784474.499652:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fe4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+17:10296:x1877773344862464:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:0.0:1790784474.499670:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784474.499690:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d39e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135014 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784474.499819:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0e00/0x2c3a1e2a079d39e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784474.499934:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0e00/0x2c3a1e2a079d39e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784474.499947:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0e00/0x2c3a1e2a079d39e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790784474.499960:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1790784474.500183:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945907103c00/0x2c3a1e2a079d39e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135014 expref: 20 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784474.500202:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0e00/0x2c3a1e2a079d39e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135014 expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784474.500210:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff945903af2b00) 00010000:00010000:0.0:1790784474.500213:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790784474.500217:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b0e00, rc 0) 00000100:00100000:0.0:1790784474.500277:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fe4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+19:10296:x1877773344862464:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 627us (1427us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1790784474.500284:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 43 00000100:00100000:2.0:1790784474.507777:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784474.507828:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784474.507926:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344862848 00000100:00100000:0.0:1790784474.507936:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344862848 00000100:00100000:0.0:1790784474.508035:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 2 00000100:00100000:1.0:1790784474.508141:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344862720 00000100:00100000:1.0:1790784474.508146:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344862720 00000100:00100000:1.0:1790784474.508195:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 44 00000100:00100000:1.0:1790784474.508204:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+20:10296:x1877773344862720:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:1.0:1790784474.508224:0:9249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784474.508241:0:9249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d39f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813501b expref: -99 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784474.508260:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906be8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+21:2350:x1877773344862848:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790784474.508276:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784474.508296:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0e00/0x2c3a1e2a079d39e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135014 expref: 21 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784474.508326:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d39fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784474.508332:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff945903af2b00) 00010000:00010000:0.0:1790784474.508339:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790784474.508433:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906be8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+20:2350:x1877773344862848:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 388us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784474.508441:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 2 00010000:00010000:1.0:1790784474.508971:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d39fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784474.508986:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d39fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790784474.509000:0:9249:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1790784474.509115:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d39f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813501b expref: 21 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784474.509148:0:9249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d39fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813501b expref: 20 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784474.509156:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff945903af2b00) 00010000:00010000:1.0:1790784474.509159:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790784474.509161:0:9249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945900031c00, rc 0) 00000100:00100000:1.0:1790784474.510117:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+20:10296:x1877773344862720:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 1910us (2344us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1790784474.510127:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 44 00000100:00100000:2.0:1790784474.521154:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784474.521511:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344862976 00000100:00100000:3.0:1790784474.521530:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344862976 00000100:00100000:3.0:1790784474.521621:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 23 00000100:00100000:3.0:1790784474.521647:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906be9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2352:x1877773344862976:12345-192.168.206.32@tcp:1:lfs.0 00010000:00010000:3.0:1790784474.521765:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3a0b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.521801:0:6668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000096bfeb68/0x2c3a1e2a079d39be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fff expref: 7 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.521843:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784474.521873:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790784474.521893:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3a0b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.521965:0:6668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000096bfeb68/0x2c3a1e2a079d39be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fff expref: 7 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.521995:0:6668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000096bfeb68/0x2c3a1e2a079d39be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fff expref: 7 pid: 6669 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784474.522010:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945907df7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6668:1877773359576448:192.168.206.32@tcp:104: 00000100:00100000:3.0:1790784474.522177:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459107179c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790784474.524631:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945907df7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6668:1877773359576448:192.168.206.32@tcp:104: 00010000:00010000:1.0:1790784474.524660:0:6668:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3a0b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784474.525469:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784474.525556:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344863104 00000100:00100000:3.0:1790784474.525563:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344863104 00002000:00100000:3.0:1790784474.525607:0:6673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff945906beaa00 x1877773344863104/t0(0) o4->b0f9e8c2-ddb0-4027-babe-0b166585860c@192.168.206.32@tcp:740/0 lens 504/0 e 0 to 0 dl 1790784485 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790784474.525618:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff945906beaa00 with x1877773344863104 ext(0->12) 00010000:00010000:3.0:1790784474.525626:0:6673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000096bfeb68/0x2c3a1e2a079d39be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fff expref: 8 pid: 6669 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.525641:0:6673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000096bfeb68/0x2c3a1e2a079d39be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fff expref: 8 pid: 6669 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790784474.525649:0:6673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff945906beaa00 00000100:00100000:3.0:1790784474.525688:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 0 00000100:00100000:3.0:1790784474.525697:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906beaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:2349:x1877773344863104:12345-192.168.206.32@tcp:4:lfs.0 00000001:00100000:2.0:1790784474.582924:0:6693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b0f9e8c2-ddb0-4027-babe-0b166585860c 00000100:00100000:1.0:1790784474.584282:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906beaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+9:2349:x1877773344863104:12345-192.168.206.32@tcp:4:lfs.0 Request processed in 58580us (58810us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1790784474.584304:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 0 00002000:00100000:1.0:1790784474.584317:0:6673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff945906beaa00 x1877773344863104/t4294967299(0) o4->b0f9e8c2-ddb0-4027-babe-0b166585860c@192.168.206.32@tcp:740/0 lens 504/448 e 0 to 0 dl 1790784485 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790784474.584329:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff945906beaa00 with x1877773344863104 ext(0->12) 00010000:00010000:1.0:1790784474.584339:0:6673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000096bfeb68/0x2c3a1e2a079d39be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fff expref: 9 pid: 6669 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784474.584359:0:6673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000096bfeb68/0x2c3a1e2a079d39be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fff expref: 9 pid: 6669 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790784474.584403:0:6673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff945906beaa00 00000100:00100000:3.0:1790784474.589483:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784474.589583:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344863232 00000100:00100000:2.0:1790784474.589593:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344863232 00010000:00010000:2.0:1790784474.589641:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000096bfeb68/0x2c3a1e2a079d39be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fff expref: 9 pid: 6669 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784474.589689:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 36 00000100:00100000:2.0:1790784474.589709:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+9:2349:x1877773344863232:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790784474.589723:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1790784474.589753:0:5804:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1790784474.589757:0:5804:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1790784474 00002000:00010000:2.0:1790784474.589760:0:5804:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1790784474 00002000:00010000:2.0:1790784474.589762:0:5804:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1790784474 00010000:00010000:2.0:1790784474.589768:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000096bfeb68/0x2c3a1e2a079d39be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fff expref: 9 pid: 6669 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.589902:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000096bfeb68/0x2c3a1e2a079d39be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fff expref: 9 pid: 6669 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.589929:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096bfeb68/0x2c3a1e2a079d39be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fff expref: 9 pid: 6669 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.589946:0:5804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790784474.589951:0:5804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790784474.589957:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3a0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.589968:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3a0b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.590031:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790784474.590097:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:2349:x1877773344863232:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 383us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784474.590105:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 36 00010000:00010000:1.0:1790784474.590205:0:6668:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3a0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784474.590216:0:6668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3a0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784474.590240:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3a0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784474.590250:0:6668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3a0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784474.590258:0:6668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3a0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784474.590265:0:6668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901525a00 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:1.0:1790784474.590270:0:6668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3a0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784474.590279:0:6668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3a0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784474.590291:0:6668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3a0b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784474.590310:0:6668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3a0b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784474.590362:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906be9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2352:x1877773344862976:12345-192.168.206.32@tcp:1:lfs.0 Request processed in 68718us (69239us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784474.590603:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 23 00000100:00100000:2.0:1790784474.595133:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784474.595285:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344863488 00000100:00100000:1.0:1790784474.595294:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344863488 00000100:00100000:1.0:1790784474.595352:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 8 00000100:00100000:1.0:1790784474.595362:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906bebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+20:10296:x1877773344863488:12345-192.168.206.32@tcp:35:lfs.0 00000004:00010000:1.0:1790784474.595453:0:5822:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d39fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813501b expref: 20 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790784474.595752:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1790784474.595820:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1790784474.596317:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1790784474.596408:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d3a12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784474.596425:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d39a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134ff1 expref: 24 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784474.596435:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d3a12 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784474.596468:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d39a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134ff1 expref: 24 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784474.596496:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d39a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134ff1 expref: 24 pid: 5819 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784474.596511:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593fe4c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5822:1877773359576576:192.168.206.32@tcp:104: 00000100:00100000:1.0:1790784474.596598:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459050c0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790784474.608570:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593fe4c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5822:1877773359576576:192.168.206.32@tcp:104: 00010000:00010000:1.0:1790784474.608600:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d3a12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784474.613525:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784474.614642:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344863616 00000100:00100000:3.0:1790784474.614654:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344863616 00010000:00010000:3.0:1790784474.614710:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d39a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134ff1 expref: 25 pid: 5819 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784474.614763:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 37 00000100:00100000:3.0:1790784474.614773:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906bea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+25:2351:x1877773344863616:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790784474.614799:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784474.614806:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d39a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134ff1 expref: 25 pid: 5819 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.614820:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d39a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134ff1 expref: 25 pid: 5819 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.614840:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d39a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838134ff1 expref: 25 pid: 5819 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.614857:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff945903af2b00) 00010000:00010000:3.0:1790784474.614862:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d3a12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.614871:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d3a12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.614879:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d3a12 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.614929:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790784474.615177:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906bea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+24:2351:x1877773344863616:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 394us (1650us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784474.615186:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 37 00010000:00010000:1.0:1790784474.616784:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d3a12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784474.616798:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d3a12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790784474.616908:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1790784474.617105:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1790784474.617222:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593fe4c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5822:1877773359576704:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790784474.617429:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784474.617472:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459050c0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790784474.618334:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359576704 00000100:00100000:0.0:1790784474.618344:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359576704 00000100:00100000:0.0:1790784474.618443:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790784474.618453:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fe4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5822:x1877773359576704:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790784474.618536:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fe4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5822:x1877773359576704:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 85us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784474.618543:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790784474.618649:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593fe4c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5822:1877773359576704:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1790784474.619273:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1790784474.619338:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945907df4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5822:1877773359576832:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790784474.619416:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784474.619437:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910158b40 going to sleep for 11 seconds 00000100:00080000:2.0:1790784474.619793:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790784474.619984:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359576832 00000100:00100000:0.0:1790784474.619990:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359576832 00000100:00100000:0.0:1790784474.620020:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790784474.620026:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5822:x1877773359576832:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790784474.620214:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5822:x1877773359576832:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 188us (798us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1790784474.620223:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790784474.620262:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945907df4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5822:1877773359576832:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1790784474.620325:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1790784474.620363:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d3a12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784474.620393:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d3a12 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784474.620409:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d3a12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784474.620415:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030e00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784474.620419:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d3a12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784474.620428:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d3a12 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784474.620441:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff945903af2b00) 00010000:00010000:0.0:1790784474.620444:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1790784474.620449:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d3a12 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784474.620456:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d3a12 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790784474.620639:0:5822:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1790784474.621330:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790784474.622020:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1790784474.622034:0:5822:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 308771658944ns, next at 309771656134ns, rc = 0 00000001:00080000:0.0:1790784474.622047:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1790784474.622101:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff945903af2b00) 00010000:00010000:0.0:1790784474.622105:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790784474.622114:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d39fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813501b expref: 28 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784474.622233:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906bebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+27:10296:x1877773344863488:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 26873us (27109us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1790784474.622253:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 8 00000020:00080000:0.0:1790784474.622257:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1790784474.628283:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784474.628516:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344863744 00000100:00100000:3.0:1790784474.628525:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344863744 00000100:00100000:3.0:1790784474.628584:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 45 00000100:00100000:3.0:1790784474.628593:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f50df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+27:10296:x1877773344863744:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:3.0:1790784474.628617:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784474.628638:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3a19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135022 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.628694:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3a19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135022 expref: 28 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.628709:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3a19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135022 expref: 28 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.628728:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a900) 00010000:00010000:3.0:1790784474.628731:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790784474.628759:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945901524000, rc 0) 00000100:00100000:3.0:1790784474.628831:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f50df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+28:10296:x1877773344863744:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 238us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784474.628839:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 45 00000100:00100000:3.0:1790784474.634070:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784474.634163:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344864000 00000100:00100000:1.0:1790784474.634172:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344864000 00000100:00100000:1.0:1790784474.634226:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 9 00000100:00100000:1.0:1790784474.634236:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc16c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+28:10296:x1877773344864000:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:1.0:1790784474.634477:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc16c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+29:10296:x1877773344864000:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 242us (415us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1790784474.634502:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 9 00000100:00100000:1.0:1790784474.763438:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784474.763534:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344864256 00000100:00100000:2.0:1790784474.763543:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344864256 00000100:00100000:2.0:1790784474.763608:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 46 00000100:00100000:2.0:1790784474.763618:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fe4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+29:10306:x1877773344864256:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:2.0:1790784474.763643:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784474.763662:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3a20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135029 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784474.763768:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1790784474.763892:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3a20 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135029 expref: 31 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.763907:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2000) 00010000:00010000:2.0:1790784474.763910:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790784474.763915:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3a20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135029 expref: 31 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.763928:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74c00, rc 0) 00000100:00100000:2.0:1790784474.763993:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fe4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+30:10306:x1877773344864256:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 378us (565us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1790784474.764000:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 46 00000100:00100000:2.0:1790784474.770563:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784474.770812:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344864384 00000100:00100000:3.0:1790784474.770822:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344864384 00000100:00100000:3.0:1790784474.770883:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 47 00000100:00100000:3.0:1790784474.770894:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+30:10306:x1877773344864384:12345-192.168.206.32@tcp:34:lfs.0 00010000:00010000:3.0:1790784474.770964:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3a2e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.770989:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3a2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.771000:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3a2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.771014:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3a35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.771021:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3a35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.771027:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3a35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.771101:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3a3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.771109:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3a3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.771127:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3a3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790784474.771163:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3a3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.771173:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3a2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.771179:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3a2e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.771185:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3a2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.771191:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901524600 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784474.771195:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3a2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.771201:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3a2e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.771210:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff945903af2300) 00010000:00010000:3.0:1790784474.771213:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784474.771217:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3a2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.771222:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3a2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.771232:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3a35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.771243:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3a35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.771248:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3a35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.771253:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901524800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784474.771255:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3a35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.771260:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3a35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.771268:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94592012a300) 00010000:00010000:3.0:1790784474.771270:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784474.771272:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3a35 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.771278:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3a35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.771292:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3a3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.771298:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3a3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.771304:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3a3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.771309:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901525a00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784474.771329:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3a3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.771337:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3a3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.771345:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a900) 00010000:00010000:3.0:1790784474.771347:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784474.771350:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3a3c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784474.771355:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3a3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784474.771511:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+30:10306:x1877773344864384:12345-192.168.206.32@tcp:34:lfs.0 Request processed in 616us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784474.771519:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 47 00000100:00100000:3.0:1790784474.776053:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784474.776204:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344864640 00000100:00100000:1.0:1790784474.776215:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344864640 00000100:00100000:1.0:1790784474.776270:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 10 00000100:00100000:1.0:1790784474.776282:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+30:10306:x1877773344864640:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:1.0:1790784474.776533:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+31:10306:x1877773344864640:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 253us (489us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1790784474.776541:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 10 00000100:00100000:1.0:1790784474.817264:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784474.817363:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344864896 00000100:00100000:2.0:1790784474.817413:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344864896 00000100:00100000:2.0:1790784474.817464:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 48 00000100:00100000:2.0:1790784474.817475:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fe4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+31:10309:x1877773344864896:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:2.0:1790784474.817497:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784474.817527:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3a43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135030 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.817612:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3a4a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.817626:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3a4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.817637:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3a4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.817652:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3a51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.817659:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3a51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.817666:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3a51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.817810:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d3a58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.817819:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d3a58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.817825:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d3a58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784474.817842:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1790784474.817930:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3a4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.817938:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3a4a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.817945:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3a4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.817950:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75200 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784474.817955:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3a4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.817962:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3a4a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.818222:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff945903af2300) 00010000:00010000:2.0:1790784474.818227:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784474.818233:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3a4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.818239:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3a4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.818253:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3a51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.818259:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3a51 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.818278:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3a51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.818283:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784474.818287:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3a51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.818293:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3a51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.818301:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff945903af2900) 00010000:00010000:2.0:1790784474.818304:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784474.818306:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3a51 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.818312:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3a51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.818351:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3a43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135030 expref: 34 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.818366:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d3a58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135030 expref: 33 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.818419:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a900) 00010000:00010000:2.0:1790784474.818422:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790784474.818425:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74e00, rc 0) 00000100:00100000:2.0:1790784474.818638:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fe4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+33:10309:x1877773344864896:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 1163us (1381us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1790784474.818655:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 48 00000100:00100000:3.0:1790784474.835045:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784474.835123:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344865024 00000100:00100000:2.0:1790784474.835132:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344865024 00000100:00100000:2.0:1790784474.835194:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 49 00000100:00100000:2.0:1790784474.835204:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+33:10309:x1877773344865024:12345-192.168.206.32@tcp:54:lfs.0 00010000:00010000:2.0:1790784474.835269:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3a66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.835284:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3a66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.835295:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3a66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.835329:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3a66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.835336:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3a66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.835342:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3a66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.835348:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74c00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784474.835352:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3a66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.835359:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3a66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.835370:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a900) 00010000:00010000:2.0:1790784474.835415:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790784474.835422:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3a66 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784474.835429:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3a66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784474.835490:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+33:10309:x1877773344865024:12345-192.168.206.32@tcp:54:lfs.0 Request processed in 287us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784474.835498:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 49 00000100:00100000:0.0:1790784474.838114:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784474.838203:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344865280 00000100:00100000:1.0:1790784474.838211:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344865280 00000100:00100000:1.0:1790784474.838264:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 11 00000100:00100000:1.0:1790784474.838273:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+33:10309:x1877773344865280:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:1.0:1790784474.838625:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+34:10309:x1877773344865280:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 352us (517us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1790784474.838634:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 11 00000100:00100000:0.0:1790784475.109573:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784475.110139:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344865536 00000100:00100000:3.0:1790784475.110148:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344865536 00000100:00100000:3.0:1790784475.110194:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 50 00000100:00100000:3.0:1790784475.110202:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+34:10340:x1877773344865536:12345-192.168.206.32@tcp:101:cat.0 00010000:00010000:3.0:1790784475.110222:0:9249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784475.110239:0:9249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945909575e00/0x2c3a1e2a079d3a6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135037 expref: -99 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784475.110334:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945909575200/0x2c3a1e2a079d3a74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784475.110360:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945909575200/0x2c3a1e2a079d3a74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784475.110407:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945909575200/0x2c3a1e2a079d3a74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790784475.110420:0:9249:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790784475.110615:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945909575e00/0x2c3a1e2a079d3a6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135037 expref: 37 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784475.110632:0:9249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945909575200/0x2c3a1e2a079d3a74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135037 expref: 36 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784475.110640:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a900) 00010000:00010000:3.0:1790784475.110643:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790784475.110646:0:9249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945909575200, rc 0) 00000100:00100000:3.0:1790784475.110702:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+36:10340:x1877773344865536:12345-192.168.206.32@tcp:101:cat.0 Request processed in 500us (1137us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1790784475.110709:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 50 00000100:00100000:1.0:1790784475.122637:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784475.122828:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344865792 00000100:00100000:3.0:1790784475.122838:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344865792 00000100:00100000:3.0:1790784475.122901:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 12 00000100:00100000:3.0:1790784475.122912:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fe4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+36:10340:x1877773344865792:12345-192.168.206.32@tcp:35:cat.0 00000100:00100000:3.0:1790784475.123148:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fe4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+37:10340:x1877773344865792:12345-192.168.206.32@tcp:35:cat.0 Request processed in 238us (520us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1790784475.123158:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 12 00000100:00100000:1.0:1790784475.123215:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784475.129196:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344865920 00000100:00100000:3.0:1790784475.129219:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344865920 00000100:00100000:3.0:1790784475.129302:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 3 00000100:00100000:3.0:1790784475.129313:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905196450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+37:2350:x1877773344865920:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790784475.129352:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784475.129394:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945909575200/0x2c3a1e2a079d3a74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135037 expref: 37 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784475.129412:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a900) 00010000:00010000:3.0:1790784475.129418:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790784475.129476:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905196450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+36:2350:x1877773344865920:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 165us (6261us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784475.129484:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 3 00000001:00080000:1.0:1790784475.199986:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967325 is committed 00000004:00080000:1.0:1790784475.200001:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1790784475.200031:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967330 is committed 00000020:00080000:1.0:1790784475.200064:0:5841:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94592aa39180 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1790784475.200068:0:5841:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff945935e65e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94592aa396c0 00000020:00080000:1.0:1790784475.200072:0:5841:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff945935e65100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94593fabc800 00000020:00080000:2.0:1790784475.200154:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1790784475.200254:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1790784475.200476:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359576960:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790784475.200546:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784475.201014:0:8181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359576960 00000100:00100000:0.0:1790784475.201021:0:8181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359576960 00000100:00100000:0.0:1790784475.201075:0:8181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790784475.201085:0:8181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fe4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3280:x1877773359576960:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1790784475.201110:0:8181:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1790784475.201142:0:8181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6abd33da, atime: 0x6abd33da, ctime: 0x6abd33da, blocks: 0x1 00010000:00010000:0.0:1790784475.201150:0:8181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3c0caee/0x2c3a1e2a079d3a82 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784475.201166:0:8181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=309s v=(0 0) 00010000:00010000:0.0:1790784475.201170:0:8181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790784475.201176:0:8181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3c0caee/0x2c3a1e2a079d3a82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784475.201193:0:8181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3c0caee/0x2c3a1e2a079d3a82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784475.201205:0:8181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3c0caee/0x2c3a1e2a079d3a82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784475.201212:0:8181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3c0caee/0x2c3a1e2a079d3a82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784475.201250:0:8181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790784475.202405:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790784475.202414:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3c0caee/0x2c3a1e2a079d3a82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784475.202424:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b0800 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:1.0:1790784475.202428:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3c0caee/0x2c3a1e2a079d3a82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784475.202438:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3c0caee/0x2c3a1e2a079d3a82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784475.202456:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3c0caee/0x2c3a1e2a079d3a82 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784475.202464:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3c0caee/0x2c3a1e2a079d3a82 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784475.202483:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784475.202485:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784475.202487:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784475.203183:0:8181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fe4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3280:x1877773359576960:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2097us (2634us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1790784475.203193:0:8181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:1.0:1790784475.206344:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94593d7f9500/2, rc 0, transno 4294967301 00000100:00100000:1.0:1790784475.206359:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359576960:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790784475.277051:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784475.278968:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344866176 00000100:00100000:2.0:1790784475.278982:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344866176 00000100:00100000:2.0:1790784475.279049:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 51 00000100:00100000:2.0:1790784475.279058:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fe4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+14:10346:x1877773344866176:12345-192.168.206.32@tcp:101:dd.0 00010000:00010000:2.0:1790784475.279081:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784475.279084:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790784475.279106:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d39da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813500d expref: 14 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.279128:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff945903af2300) 00010000:00010000:2.0:1790784475.279132:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790784475.279144:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3a89 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813503e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.279222:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3a90 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.279234:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d3a58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135030 expref: 14 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.279255:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3a90 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.279284:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d3a58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135030 expref: 14 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.279296:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d3a58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135030 expref: 14 pid: 5819 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784475.279308:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f50d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5820:1877773359577088:192.168.206.32@tcp:104: 00000100:00100000:2.0:1790784475.279451:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff94590aec0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790784475.287007:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f50d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5820:1877773359577088:192.168.206.32@tcp:104: 00010000:00010000:2.0:1790784475.287035:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3a90 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784475.293601:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784475.293747:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344866304 00000100:00100000:2.0:1790784475.293756:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344866304 00010000:00010000:2.0:1790784475.293798:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d3a58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135030 expref: 15 pid: 5819 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784475.293834:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 38 00000100:00100000:2.0:1790784475.293843:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fe4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+15:2352:x1877773344866304:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790784475.293855:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784475.293862:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d3a58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135030 expref: 15 pid: 5819 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.293887:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d3a58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135030 expref: 15 pid: 5819 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.293909:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d3a58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135030 expref: 15 pid: 5819 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.293927:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a900) 00010000:00010000:2.0:1790784475.293932:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3a90 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.293943:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3a90 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.293951:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3a90 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.293987:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790784475.294112:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fe4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+14:2352:x1877773344866304:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 270us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784475.294122:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 38 00010000:00010000:3.0:1790784475.294135:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3a90 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784475.294146:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3a90 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790784475.294165:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1790784475.294332:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3a89 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813503e expref: 15 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784475.294348:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3a90 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813503e expref: 14 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784475.294356:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a900) 00010000:00010000:3.0:1790784475.294358:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790784475.294361:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe75400, rc 0) 00000100:00100000:3.0:1790784475.294437:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fe4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+14:10346:x1877773344866176:12345-192.168.206.32@tcp:101:dd.0 Request processed in 15379us (17395us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1790784475.294444:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 51 00000100:00100000:0.0:1790784475.310023:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784475.310098:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344866560 00000100:00100000:3.0:1790784475.310107:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344866560 00000100:00100000:3.0:1790784475.310167:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 52 00000100:00100000:3.0:1790784475.310177:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+14:10346:x1877773344866560:12345-192.168.206.32@tcp:36:dd.0 00010000:00010000:3.0:1790784475.310465:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945909575e00/0x2c3a1e2a079d3a9e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784475.310482:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945909575e00/0x2c3a1e2a079d3a9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784475.310494:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945909575e00/0x2c3a1e2a079d3a9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790784475.310537:0:9249:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1790784475.310557:0:9249:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000426bd752 reply state 000000008107a9b9 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff945909575e00/0x2c3a1e2a079d3a9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784475.310565:0:9249:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790784475.310727:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+17:10346:x1877773344866560:12345-192.168.206.32@tcp:36:dd.0 Request processed in 551us (712us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1790784475.310735:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 52 00000020:00080000:3.0:1790784475.310750:0:9249:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790784475.319102:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945909575e00/0x2c3a1e2a079d3a9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.319119:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945909575e00/0x2c3a1e2a079d3a9e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.319127:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945909575e00/0x2c3a1e2a079d3a9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.319150:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945909575e00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784475.319154:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945909575e00/0x2c3a1e2a079d3a9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.319163:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945909575e00/0x2c3a1e2a079d3a9e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.319180:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a900) 00010000:00010000:2.0:1790784475.319182:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784475.319187:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945909575e00/0x2c3a1e2a079d3a9e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.319193:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945909575e00/0x2c3a1e2a079d3a9e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784475.565894:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784475.565933:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784475.565964:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784475.566016:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784475.566057:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344866944 00000100:00100000:0.0:1790784475.566065:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344866944 00000100:00100000:0.0:1790784475.566110:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 61 00000100:00100000:0.0:1790784475.566119:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2352:x1877773344866944:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:0.0:1790784475.566180:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2352:x1877773344866944:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 62us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784475.566187:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 61 00000100:00100000:3.0:1790784475.566685:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344866816 00000100:00100000:3.0:1790784475.566690:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344866816 00000100:00100000:3.0:1790784475.566778:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344867072 00000100:00100000:3.0:1790784475.566781:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344867072 00000100:00100000:3.0:1790784475.566812:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 132 00000100:00100000:3.0:1790784475.566820:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+16:2352:x1877773344866816:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1790784475.566874:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+16:2352:x1877773344866816:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 55us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784475.566881:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 132 00000100:00100000:3.0:1790784475.566893:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 133 00000100:00100000:3.0:1790784475.566898:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2352:x1877773344867072:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1790784475.566916:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2352:x1877773344867072:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 19us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784475.566921:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 133 00000100:00080000:3.0:1790784475.566935:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790784475.567022:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344866688 00000100:00100000:1.0:1790784475.567027:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344866688 00000100:00100000:1.0:1790784475.567070:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 286 00000100:00100000:1.0:1790784475.567076:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2352:x1877773344866688:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784475.567098:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903697050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2352:x1877773344866688:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 24us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784475.567104:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 286 00000100:00100000:0.0:1790784475.635754:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784475.635966:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344867200 00000100:00100000:3.0:1790784475.636045:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344867200 00000100:00100000:3.0:1790784475.636137:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 53 00000100:00100000:3.0:1790784475.636150:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+16:10360:x1877773344867200:12345-192.168.206.32@tcp:101:stat.0 00010000:00010000:3.0:1790784475.636539:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784475.636628:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945909575200/0x2c3a1e2a079d3aa5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135045 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784475.636719:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945909574600/0x2c3a1e2a079d3aac lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784475.636746:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945909574600/0x2c3a1e2a079d3aac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784475.636760:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945909574600/0x2c3a1e2a079d3aac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784475.636854:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945909575e00/0x2c3a1e2a079d3ab3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784475.636880:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945909575e00/0x2c3a1e2a079d3ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784475.636887:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945909575e00/0x2c3a1e2a079d3ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784475.637426:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3aba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784475.637443:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3a90 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813503e expref: 17 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784475.637452:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3aba lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784475.637495:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3a90 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813503e expref: 17 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784475.637513:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3a90 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813503e expref: 17 pid: 5820 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784475.637529:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945907df5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5820:1877773359577216:192.168.206.32@tcp:104: 00000100:00100000:3.0:1790784475.637897:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff945911e9ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1790784475.643938:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945907df5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5820:1877773359577216:192.168.206.32@tcp:104: 00010000:00010000:3.0:1790784475.643980:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3aba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784475.645048:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784475.645143:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344867456 00000100:00100000:3.0:1790784475.645184:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344867456 00000100:00100000:3.0:1790784475.645260:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 13 00000100:00100000:3.0:1790784475.645272:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d4c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+18:5591:x1877773344867456:12345-192.168.206.32@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1790784475.645891:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d4c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+19:5591:x1877773344867456:12345-192.168.206.32@tcp:35:ldlm_bl.0 Request processed in 617us (846us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1790784475.645901:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 13 00010000:00010000:2.0:1790784475.648034:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784475.649271:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784475.649474:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344867584 00000100:00100000:2.0:1790784475.649487:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344867584 00010000:00010000:2.0:1790784475.649537:0:8421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3a90 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813503e expref: 19 pid: 5820 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784475.649594:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 39 00000100:00100000:2.0:1790784475.649606:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590686a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+19:2351:x1877773344867584:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790784475.649623:0:8421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784475.649631:0:8421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3a90 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813503e expref: 19 pid: 5820 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.649646:0:8421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3a90 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813503e expref: 19 pid: 5820 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.649681:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3a90 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813503e expref: 19 pid: 5820 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.649701:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a900) 00010000:00010000:2.0:1790784475.649708:0:8421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3aba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.649720:0:8421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3aba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.649728:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3aba lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.649886:0:8421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790784475.649952:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590686a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+18:2351:x1877773344867584:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 347us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784475.649961:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 39 00010000:00010000:0.0:1790784475.650430:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3aba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784475.650441:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3aba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790784475.650504:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1790784475.650518:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790784475.651044:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3aba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784475.651064:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3aba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784475.651077:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945909574600/0x2c3a1e2a079d3aac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784475.651084:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945909574600/0x2c3a1e2a079d3aac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784475.651093:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945909574600/0x2c3a1e2a079d3aac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784475.651100:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945909574600 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784475.651105:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945909574600/0x2c3a1e2a079d3aac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784475.651114:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945909574600/0x2c3a1e2a079d3aac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784475.651129:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff945903af2300) 00010000:00010000:0.0:1790784475.651133:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784475.651138:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945909574600/0x2c3a1e2a079d3aac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784475.651146:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945909574600/0x2c3a1e2a079d3aac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784475.651165:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945909575e00/0x2c3a1e2a079d3ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784475.651537:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945909575e00/0x2c3a1e2a079d3ab3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784475.651544:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945909575e00/0x2c3a1e2a079d3ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784475.651549:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945909575e00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784475.651552:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945909575e00/0x2c3a1e2a079d3ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784475.651608:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945909575e00/0x2c3a1e2a079d3ab3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784475.651621:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94592012a300) 00010000:00010000:0.0:1790784475.651623:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784475.651627:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945909575e00/0x2c3a1e2a079d3ab3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784475.651634:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945909575e00/0x2c3a1e2a079d3ab3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784475.651692:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945909575200/0x2c3a1e2a079d3aa5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135045 expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784475.651710:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3aba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135045 expref: 17 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784475.651718:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a900) 00010000:00010000:0.0:1790784475.651720:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790784475.651729:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945901525e00, rc 0) 00000100:00100000:0.0:1790784475.655721:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+17:10360:x1877773344867200:12345-192.168.206.32@tcp:101:stat.0 Request processed in 19557us (20155us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784475.655747:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 53 00000100:00100000:0.0:1790784475.795723:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784475.796367:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344867840 00000100:00100000:2.0:1790784475.796550:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344867840 00000100:00100000:3.0:1790784475.796960:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 54 00000100:00100000:3.0:1790784475.796974:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590686b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+17:10366:x1877773344867840:12345-192.168.206.32@tcp:36:truncate.0 00010000:00010000:3.0:1790784475.797062:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784475.797098:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3aba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135045 expref: 17 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784475.797125:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a900) 00010000:00010000:3.0:1790784475.797132:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790784475.797626:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3ac1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784475.797646:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3ac1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784475.797658:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3ac1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790784475.797719:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1790784475.797759:0:5818:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f15d5df reply state 00000000bcec106d transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3ac1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784475.798030:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790784475.801594:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590686b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+19:10366:x1877773344867840:12345-192.168.206.32@tcp:36:truncate.0 Request processed in 4603us (5867us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1790784475.801611:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 54 00000020:00080000:3.0:1790784475.801622:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790784475.823355:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3ac1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784475.823397:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3ac1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784475.823407:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3ac1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784475.823673:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901525a00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784475.823679:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3ac1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784475.823689:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3ac1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784475.823710:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a900) 00010000:00010000:3.0:1790784475.823713:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784475.823719:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3ac1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784475.823727:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3ac1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784475.935746:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784475.936023:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344867968 00000100:00100000:2.0:1790784475.936036:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344867968 00000100:00100000:2.0:1790784475.936118:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 55 00000100:00100000:2.0:1790784475.936132:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590686ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+18:10380:x1877773344867968:12345-192.168.206.32@tcp:101:stat.0 00010000:00010000:2.0:1790784475.936167:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784475.936194:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3ac8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813504c expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.936446:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d3acf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.936484:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d3acf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.936691:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d3acf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.936711:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3ad6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.936720:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.936728:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.942121:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3add lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.942155:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3add lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.944859:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3add lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784475.944945:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1790784475.944951:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790784475.944992:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3add lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.945012:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3add lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.945049:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d3acf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.945057:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d3acf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.945065:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d3acf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.945071:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74e00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784475.945076:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d3acf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.945085:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d3acf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.945102:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff945903af2300) 00010000:00010000:2.0:1790784475.945106:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784475.945112:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d3acf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.945118:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d3acf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.945141:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.945148:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3ad6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.945154:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3ad6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.945165:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75200 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784475.945169:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3ad6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.945175:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3ad6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.945184:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff945903af2400) 00010000:00010000:2.0:1790784475.945187:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784475.945190:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3ad6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.945197:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3ad6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.945253:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3ac8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813504c expref: 20 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.945268:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3add lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813504c expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784475.945276:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a900) 00010000:00010000:2.0:1790784475.945279:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790784475.945282:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74200, rc 0) 00000100:00100000:2.0:1790784475.945421:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590686ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+19:10380:x1877773344867968:12345-192.168.206.32@tcp:101:stat.0 Request processed in 9291us (9698us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784475.945431:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 55 00000100:00100000:1.0:1790784476.073076:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784476.073263:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344868224 00000100:00100000:0.0:1790784476.073282:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344868224 00000100:00100000:0.0:1790784476.073352:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 56 00000100:00100000:0.0:1790784476.073361:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fe4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+19:10390:x1877773344868224:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:0.0:1790784476.073405:0:9249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784476.073423:0:9249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d3ae4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135053 expref: -99 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790784476.073515:0:9249:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1790784476.073621:0:9249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d3ae4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135053 expref: 21 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.073635:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2000) 00010000:00010000:0.0:1790784476.073638:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790784476.073643:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d3ae4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135053 expref: 21 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.073655:0:9249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b0600, rc 0) 00000100:00100000:0.0:1790784476.073703:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fe4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+20:10390:x1877773344868224:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 344us (637us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1790784476.073711:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 56 00000100:00080000:3.0:1790784476.074989:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790784476.077414:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784476.077649:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344868480 00000100:00100000:0.0:1790784476.077672:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344868480 00000100:00100000:0.0:1790784476.077726:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 14 00000100:00100000:0.0:1790784476.077745:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+20:10390:x1877773344868480:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:0.0:1790784476.077982:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+21:10390:x1877773344868480:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 247us (609us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1790784476.077990:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 14 00000100:00100000:0.0:1790784476.151587:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784476.151690:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344868736 00000100:00100000:3.0:1790784476.151700:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344868736 00000100:00100000:3.0:1790784476.151833:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 57 00000100:00100000:3.0:1790784476.151844:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590686a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+21:10396:x1877773344868736:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:3.0:1790784476.151869:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784476.151888:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3af2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813505a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784476.151987:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3af9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784476.152003:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3add lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813504c expref: 22 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784476.152012:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3af9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784476.152043:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3add lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813504c expref: 22 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784476.152057:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3add lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813504c expref: 22 pid: 5819 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784476.152070:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945907df4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5820:1877773359577344:192.168.206.32@tcp:104: 00000100:00100000:3.0:1790784476.152155:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff945911e9cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790784476.161263:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784476.162965:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344868864 00000100:00100000:2.0:1790784476.163000:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344868864 00010000:00010000:2.0:1790784476.163045:0:8480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3add lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813504c expref: 23 pid: 5819 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784476.163091:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 40 00000100:00100000:2.0:1790784476.163101:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b0f9e8c2-ddb0-4027-babe-0b166585860c+23:2352:x1877773344868864:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790784476.163116:0:8480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784476.163122:0:8480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3add lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813504c expref: 23 pid: 5819 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.163145:0:8480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3add lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813504c expref: 23 pid: 5819 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.163167:0:8480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a900) 00010000:00010000:2.0:1790784476.163172:0:8480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3af9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.163182:0:8480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3af9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.163190:0:8480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3af9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.163210:0:8480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790784476.163563:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b0f9e8c2-ddb0-4027-babe-0b166585860c+23:2352:x1877773344868864:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 463us (2307us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784476.163572:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 40 00010000:00010000:0.0:1790784476.168117:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3add lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813504c expref: 22 pid: 5819 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784476.168263:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945907df4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5820:1877773359577344:192.168.206.32@tcp:104: 00010000:00010000:0.0:1790784476.168288:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3af9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.168298:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3af9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.168304:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3af9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790784476.168326:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1790784476.168538:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3af2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813505a expref: 23 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.168558:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3af9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813505a expref: 22 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.168566:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a900) 00010000:00010000:0.0:1790784476.168581:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790784476.168585:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945901525e00, rc 0) 00000100:00100000:0.0:1790784476.168940:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590686a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+22:10396:x1877773344868736:12345-192.168.206.32@tcp:101:bash.0 Request processed in 17096us (17361us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1790784476.168950:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 57 00000100:00100000:3.0:1790784476.178195:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784476.179670:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344869120 00000100:00100000:0.0:1790784476.179684:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344869120 00000100:00100000:0.0:1790784476.179758:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 58 00000100:00100000:0.0:1790784476.179768:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+22:10396:x1877773344869120:12345-192.168.206.32@tcp:36:bash.0 00010000:00010000:0.0:1790784476.180287:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d3b07 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.180305:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d3b07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.180316:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d3b07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790784476.180368:0:9249:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1790784476.180421:0:9249:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f6b1a624 reply state 00000000da84592a transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d3b07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784476.180431:0:9249:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790784476.180540:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+25:10396:x1877773344869120:12345-192.168.206.32@tcp:36:bash.0 Request processed in 772us (2358us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1790784476.180547:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 58 00000020:00080000:0.0:1790784476.180553:0:9249:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790784476.184115:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d3b07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.184163:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d3b07 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.184171:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d3b07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.184179:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b1a00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784476.184184:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d3b07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.184193:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d3b07 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.184213:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a900) 00010000:00010000:2.0:1790784476.184216:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784476.184222:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d3b07 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.184227:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d3b07 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784476.194337:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784476.194613:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344869248 00000100:00100000:2.0:1790784476.194626:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344869248 00000100:00100000:2.0:1790784476.194697:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 59 00000100:00100000:2.0:1790784476.194710:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+24:10396:x1877773344869248:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:2.0:1790784476.194757:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784476.194796:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3b0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135061 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.194921:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3b15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.194957:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3af9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813505a expref: 25 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.194969:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3b15 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.195014:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3af9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813505a expref: 25 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.195031:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3af9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813505a expref: 25 pid: 5820 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784476.195048:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f50d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5819:1877773359577472:192.168.206.32@tcp:104: 00000100:00100000:2.0:1790784476.195167:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff94590aec0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790784476.199621:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f50d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5819:1877773359577472:192.168.206.32@tcp:104: 00010000:00010000:2.0:1790784476.199677:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3b15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784476.203522:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784476.204707:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344869376 00000100:00100000:2.0:1790784476.204727:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344869376 00010000:00010000:2.0:1790784476.204805:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3af9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813505a expref: 26 pid: 5820 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784476.204862:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 41 00000100:00100000:2.0:1790784476.204874:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fe4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+26:2352:x1877773344869376:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790784476.204894:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784476.204932:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3af9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813505a expref: 26 pid: 5820 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.204948:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3af9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813505a expref: 26 pid: 5820 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.204984:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3af9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813505a expref: 26 pid: 5820 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.205012:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a900) 00010000:00010000:2.0:1790784476.205019:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3b15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.205029:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3b15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.205038:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3b15 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.205340:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790784476.205635:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3b15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784476.205660:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3b15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790784476.205720:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1790784476.205725:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790784476.205764:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3b15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784476.205804:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3b0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135061 expref: 26 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784476.205824:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3b15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135061 expref: 25 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784476.205832:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a900) 00010000:00010000:3.0:1790784476.205834:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790784476.205837:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe75200, rc 0) 00000100:00100000:2.0:1790784476.205891:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fe4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+25:2352:x1877773344869376:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 1018us (2377us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784476.205912:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 41 00000100:00100000:3.0:1790784476.222156:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+24:10396:x1877773344869248:12345-192.168.206.32@tcp:101:bash.0 Request processed in 27431us (27818us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784476.222174:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 59 00000100:00100000:3.0:1790784476.240073:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784476.240664:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344869632 00000100:00100000:0.0:1790784476.240679:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344869632 00000100:00100000:0.0:1790784476.240780:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 15 00000100:00100000:0.0:1790784476.240809:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc14850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+24:10396:x1877773344869632:12345-192.168.206.32@tcp:35:bash.0 00000100:00100000:0.0:1790784476.241167:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc14850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+25:10396:x1877773344869632:12345-192.168.206.32@tcp:35:bash.0 Request processed in 359us (1116us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1790784476.241175:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 15 00000100:00100000:0.0:1790784476.365673:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784476.365933:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344869888 00000100:00100000:3.0:1790784476.365947:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344869888 00000100:00100000:3.0:1790784476.366026:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 60 00000100:00100000:3.0:1790784476.366039:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590686b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+25:10406:x1877773344869888:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:3.0:1790784476.366089:0:9249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784476.366117:0:9249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3b1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135068 expref: -99 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790784476.366292:0:9249:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1790784476.366502:0:9249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3b1c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135068 expref: 27 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784476.366521:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2000) 00010000:00010000:3.0:1790784476.366524:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790784476.366532:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3b1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135068 expref: 27 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784476.366562:0:9249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945901524600, rc 0) 00000100:00100000:3.0:1790784476.366641:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590686b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+26:10406:x1877773344869888:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 605us (985us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1790784476.366650:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 60 00000100:00100000:1.0:1790784476.372369:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784476.372519:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344870016 00000100:00100000:0.0:1790784476.372531:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344870016 00000100:00100000:0.0:1790784476.372604:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 61 00000100:00100000:0.0:1790784476.372615:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fe4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+26:10406:x1877773344870016:12345-192.168.206.32@tcp:34:lfs.0 00010000:00010000:0.0:1790784476.372742:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d3b2a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.372766:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d3b2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.372790:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d3b2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.372808:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3b31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.372815:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.372822:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.373228:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3b38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.373253:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3b38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.373262:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3b38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790784476.373318:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3b38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.373333:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d3b2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.373341:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d3b2a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.373349:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d3b2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.373357:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b1600 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784476.373362:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d3b2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.373424:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d3b2a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.373440:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff945903af2300) 00010000:00010000:0.0:1790784476.373444:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784476.373451:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d3b2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.373459:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d3b2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.373489:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.373496:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3b31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.373503:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3b31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.373509:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b1800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784476.373512:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3b31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.373519:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3b31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.373528:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff945903a23a00) 00010000:00010000:0.0:1790784476.373530:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784476.373534:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3b31 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.373540:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3b31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.373559:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3b38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.373566:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3b38 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.373572:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3b38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.373584:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b0400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784476.373587:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3b38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.373594:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3b38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.373603:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a900) 00010000:00010000:0.0:1790784476.373605:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784476.373608:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3b38 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.373613:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3b38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784476.373744:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fe4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+26:10406:x1877773344870016:12345-192.168.206.32@tcp:34:lfs.0 Request processed in 1115us (1375us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784476.373755:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 61 00000100:00100000:0.0:1790784476.381462:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784476.381741:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344870272 00000100:00100000:2.0:1790784476.381754:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344870272 00000100:00100000:2.0:1790784476.381839:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 16 00000100:00100000:2.0:1790784476.381852:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906868e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+26:10406:x1877773344870272:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:2.0:1790784476.382229:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906868e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+27:10406:x1877773344870272:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 378us (780us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1790784476.382259:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 16 00000100:00100000:1.0:1790784476.455583:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784476.455984:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344870528 00000100:00100000:3.0:1790784476.456000:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344870528 00000100:00100000:3.0:1790784476.456087:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 62 00000100:00100000:3.0:1790784476.456100:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fe4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+27:10409:x1877773344870528:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:3.0:1790784476.456132:0:9249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784476.456158:0:9249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3b3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813506f expref: -99 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784476.456257:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3b46 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784476.456275:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3b46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784476.456314:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3b46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784476.456334:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3b4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784476.456342:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3b4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784476.456349:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3b4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.457097:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d3b54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.457113:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d3b54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.457125:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d3b54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784476.457137:0:9249:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1790784476.457272:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3b46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.457281:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3b46 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.457290:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3b46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.457297:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901524800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784476.457302:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3b46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.457312:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3b46 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.457327:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff945903af2300) 00010000:00010000:2.0:1790784476.457331:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784476.457338:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3b46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.457357:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3b46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.457427:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3b4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.457434:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3b4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.457441:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3b4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.457446:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901525e00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784476.457450:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3b4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.457457:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3b4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.457465:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94592012af00) 00010000:00010000:2.0:1790784476.457468:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784476.457471:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3b4d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.457477:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3b4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.457543:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3b3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813506f expref: 30 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.457560:0:9249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d3b54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813506f expref: 29 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.457575:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a900) 00010000:00010000:2.0:1790784476.457578:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790784476.457581:0:9249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74e00, rc 0) 00000100:00100000:2.0:1790784476.457682:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fe4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+29:10409:x1877773344870528:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 1584us (2113us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1790784476.457692:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 62 00000100:00100000:3.0:1790784476.467229:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784476.467355:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344870656 00000100:00100000:0.0:1790784476.467368:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344870656 00000100:00100000:0.0:1790784476.467458:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 63 00000100:00100000:0.0:1790784476.467468:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+29:10409:x1877773344870656:12345-192.168.206.32@tcp:54:lfs.0 00010000:00010000:0.0:1790784476.467533:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3b62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.467551:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3b62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.467580:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3b62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.467607:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3b62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.467614:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3b62 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.467621:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3b62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.467628:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b1800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784476.467632:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3b62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.467639:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3b62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.467651:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a900) 00010000:00010000:0.0:1790784476.467654:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790784476.467659:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3b62 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.467666:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3b62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784476.467754:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+29:10409:x1877773344870656:12345-192.168.206.32@tcp:54:lfs.0 Request processed in 287us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784476.467762:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 63 00000100:00100000:0.0:1790784476.469875:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784476.470234:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344870912 00000100:00100000:2.0:1790784476.470254:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344870912 00000100:00100000:2.0:1790784476.470346:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 17 00000100:00100000:2.0:1790784476.470359:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590686aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+29:10409:x1877773344870912:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:2.0:1790784476.471921:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590686aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+30:10409:x1877773344870912:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 1555us (2043us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1790784476.471939:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 17 00000100:00100000:2.0:1790784476.472553:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784476.473317:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344871040 00000100:00100000:3.0:1790784476.473327:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344871040 00000100:00100000:3.0:1790784476.473471:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 4 00000100:00100000:3.0:1790784476.473481:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f50d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+30:2352:x1877773344871040:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790784476.473497:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784476.473520:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d3b54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813506f expref: 30 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784476.473539:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a900) 00010000:00010000:3.0:1790784476.473545:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790784476.473597:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f50d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+29:2352:x1877773344871040:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 118us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784476.473604:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 4 00010000:00010000:1.0:1790784476.666797:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784476.732356:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784476.732530:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344871296 00000100:00100000:2.0:1790784476.732557:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344871296 00000100:00100000:2.0:1790784476.732625:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 64 00000100:00100000:2.0:1790784476.732637:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+29:10427:x1877773344871296:12345-192.168.206.32@tcp:101:cat.0 00010000:00010000:2.0:1790784476.732671:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784476.732698:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d3b69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135076 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.732849:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3b70 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.732885:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3b70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.732898:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3b70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784476.732912:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1790784476.733089:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d3b69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135076 expref: 32 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.733112:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3b70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135076 expref: 31 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.733121:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a900) 00010000:00010000:2.0:1790784476.733124:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790784476.733129:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74000, rc 0) 00000100:00100000:2.0:1790784476.733215:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+31:10427:x1877773344871296:12345-192.168.206.32@tcp:101:cat.0 Request processed in 580us (873us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1790784476.733222:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 64 00000100:00100000:0.0:1790784476.786611:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784476.787763:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344871424 00000100:00100000:3.0:1790784476.787802:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344871424 00000100:00100000:3.0:1790784476.787899:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 65 00000100:00100000:3.0:1790784476.787911:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+31:10428:x1877773344871424:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:3.0:1790784476.787944:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784476.787984:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3b7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813507d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784476.788315:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3b85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784476.788333:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3b85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784476.788346:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3b85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790784476.788432:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1790784476.788436:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790784476.788457:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3b85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784476.788488:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3b7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813507d expref: 33 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784476.788512:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3b85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813507d expref: 32 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784476.788521:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff945903af2300) 00010000:00010000:3.0:1790784476.788524:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790784476.788527:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945901524600, rc 0) 00000100:00100000:3.0:1790784476.788637:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+32:10428:x1877773344871424:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 727us (2038us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784476.788644:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 65 00000100:00100000:3.0:1790784476.796144:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784476.796330:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344871808 00000100:00100000:0.0:1790784476.796342:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344871808 00000100:00100000:0.0:1790784476.796458:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 18 00000100:00100000:0.0:1790784476.796471:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+32:10428:x1877773344871808:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:0.0:1790784476.797138:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+33:10428:x1877773344871808:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 666us (1003us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1790784476.797148:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 18 00000100:00100000:1.0:1790784476.801516:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784476.801804:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344871936 00000100:00100000:2.0:1790784476.801817:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344871936 00000100:00100000:2.0:1790784476.801903:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 5 00000100:00100000:2.0:1790784476.801916:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b0f9e8c2-ddb0-4027-babe-0b166585860c+33:10428:x1877773344871936:12345-192.168.206.32@tcp:103:lfs.0 00010000:00010000:2.0:1790784476.801964:0:8480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790784476.801996:0:8480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3b15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135061 expref: 33 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.802040:0:8480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3b70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135076 expref: 32 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.802055:0:8480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3a19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135022 expref: 31 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.802067:0:8480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a900) 00010000:00010000:2.0:1790784476.802080:0:8480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790784476.802151:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b0f9e8c2-ddb0-4027-babe-0b166585860c+30:10428:x1877773344871936:12345-192.168.206.32@tcp:103:lfs.0 Request processed in 238us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784476.802159:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 5 00000100:00100000:3.0:1790784476.806223:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784476.813156:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344872064 00000100:00100000:2.0:1790784476.813176:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344872064 00000100:00100000:2.0:1790784476.813270:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 66 00000100:00100000:2.0:1790784476.813282:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+30:10428:x1877773344872064:12345-192.168.206.32@tcp:58:lfs.0 00010000:00010000:2.0:1790784476.813443:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d3b8c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.813464:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d3b8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784476.813478:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d3b8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790784476.814548:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790784476.817625:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1790784476.817806:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1790784476.817999:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+30:10428:x1877773344872064:12345-192.168.206.32@tcp:58:lfs.0 Request processed in 4712us (11783us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784476.818013:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 66 00000100:00100000:3.0:1790784476.847330:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784476.847527:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344872192 00000100:00100000:0.0:1790784476.847539:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344872192 00000100:00100000:0.0:1790784476.847614:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 67 00000100:00100000:0.0:1790784476.847626:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+30:10430:x1877773344872192:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:0.0:1790784476.847652:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784476.847677:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3b93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135084 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.848061:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d3b9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.848081:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d3b9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.848096:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d3b9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.848114:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3ba1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.848121:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.848145:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.848482:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d3ba8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.848491:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d3ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.848499:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d3ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790784476.848545:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1790784476.848550:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790784476.848573:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d3ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.848586:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d3ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.848594:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d3b9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.848600:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d3b9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.848608:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d3b9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.848614:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b1600 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784476.848618:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d3b9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.848633:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d3b9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.848648:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff945903af2300) 00010000:00010000:0.0:1790784476.848651:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784476.848657:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d3b9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.848664:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d3b9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.848680:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.848686:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3ba1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.848692:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3ba1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.848697:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b0400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784476.848700:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3ba1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.848706:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3ba1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.848713:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff945903a23a00) 00010000:00010000:0.0:1790784476.848716:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784476.848719:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3ba1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.848749:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3ba1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.849235:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3b93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135084 expref: 32 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.849255:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d3ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135084 expref: 31 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784476.849263:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff945903af2400) 00010000:00010000:0.0:1790784476.849266:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790784476.849269:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b1c00, rc 0) 00000100:00100000:0.0:1790784476.849458:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+31:10430:x1877773344872192:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 1833us (2139us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784476.849468:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 67 00000040:00080000:2.0:1790784477.312570:0:11656:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790784477.312583:0:11656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790784477.312655:0:11656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1790784477.312664:0:11656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790784477.312850:0:11656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f50ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11656:1877773359577600:192.168.206.32@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790784477.312971:0:11656:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459056c9780 going to sleep for 11 seconds 00000100:00100000:2.0:1790784477.316275:0:11656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f50ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11656:1877773359577600:192.168.206.32@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790784477.329011:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784477.329105:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344872320 00000100:00100000:2.0:1790784477.329118:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344872320 00000100:00100000:2.0:1790784477.329187:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 1 00000100:00100000:2.0:1790784477.329200:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b0f9e8c2-ddb0-4027-babe-0b166585860c+31:10441:x1877773344872320:12345-192.168.206.32@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1790784477.329317:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b0f9e8c2-ddb0-4027-babe-0b166585860c+31:10441:x1877773344872320:12345-192.168.206.32@tcp:900:lhsmtool_posix.0 Request processed in 120us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784477.329326:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 1 00000100:00100000:2.0:1790784477.343717:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784477.343813:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344872448 00000100:00100000:0.0:1790784477.343825:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344872448 00000100:00100000:0.0:1790784477.343900:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 68 00000100:00100000:0.0:1790784477.343912:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f50ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+31:10441:x1877773344872448:12345-192.168.206.32@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790784477.343954:0:9249:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790784477.344098:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f50ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+31:10441:x1877773344872448:12345-192.168.206.32@tcp:53:lhsmtool_posix.0 Request processed in 188us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784477.344106:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 68 00000100:00100000:3.0:1790784477.350559:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784477.350666:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344872576 00000100:00100000:2.0:1790784477.350679:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344872576 00000100:00100000:2.0:1790784477.350755:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 69 00000100:00100000:2.0:1790784477.350771:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+31:10441:x1877773344872576:12345-192.168.206.32@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790784477.350861:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3baf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.350882:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3baf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.350916:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3baf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.350935:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3bb6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.350943:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.350950:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.350991:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3bbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.351001:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3bbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.351008:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3bbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784477.351063:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1790784477.351068:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790784477.351081:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3bbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.351093:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3baf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.351101:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3baf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.351120:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3baf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.351127:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784477.351132:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3baf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.351141:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3baf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.351155:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94592012a400) 00010000:00010000:2.0:1790784477.351158:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784477.351163:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3baf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.351170:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3baf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.351186:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.351192:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3bb6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.351199:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.351203:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75200 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784477.351206:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.351221:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3bb6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.351229:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff945903af2900) 00010000:00010000:2.0:1790784477.351232:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784477.351234:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3bb6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.351240:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3bb6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.351256:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3bbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.351262:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3bbd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.351267:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3bbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.351272:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784477.351275:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3bbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.351281:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3bbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.351288:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff945903af2400) 00010000:00010000:2.0:1790784477.351291:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784477.351294:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3bbd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.351310:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3bbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784477.351451:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+31:10441:x1877773344872576:12345-192.168.206.32@tcp:34:lhsmtool_posix.0 Request processed in 681us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784477.351460:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 69 00000100:00100000:3.0:1790784477.355142:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784477.355275:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344872832 00000100:00100000:0.0:1790784477.355289:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344872832 00000100:00100000:0.0:1790784477.355354:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 70 00000100:00100000:0.0:1790784477.355418:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+31:10441:x1877773344872832:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790784477.355446:0:9249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784477.355471:0:9249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3bc4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813508b expref: -99 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.355597:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3bcb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.355616:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3bcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.355629:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3bcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790784477.355642:0:9249:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1790784477.355782:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3bcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.355791:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3bcb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.355799:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3bcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.355805:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b0400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784477.355810:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3bcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.355818:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3bcb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.355832:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff945903af2400) 00010000:00010000:0.0:1790784477.355841:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790784477.355848:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3bcb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.355854:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3bcb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.355912:0:9249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3bc4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813508b expref: 33 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.355923:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94592012a400) 00010000:00010000:0.0:1790784477.355925:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790784477.355929:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3bc4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813508b expref: 33 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.355943:0:9249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b1800, rc 0) 00000100:00100000:0.0:1790784477.356030:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+32:10441:x1877773344872832:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 617us (903us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1790784477.356037:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 70 00000100:00100000:3.0:1790784477.360640:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784477.360837:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344872960 00000100:00100000:2.0:1790784477.360850:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344872960 00000100:00100000:2.0:1790784477.360920:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 71 00000100:00100000:2.0:1790784477.360932:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+32:10441:x1877773344872960:12345-192.168.206.32@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790784477.360988:0:5819:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790784477.361548:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+32:10441:x1877773344872960:12345-192.168.206.32@tcp:53:lhsmtool_posix.0 Request processed in 615us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784477.361557:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 71 00000100:00100000:3.0:1790784477.368810:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784477.370218:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344873216 00000100:00100000:2.0:1790784477.370238:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344873216 00000100:00100000:2.0:1790784477.370326:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 72 00000100:00100000:2.0:1790784477.370338:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+32:10441:x1877773344873216:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790784477.370363:0:9249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784477.370367:0:9249:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790784477.370419:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3b85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813507d expref: 32 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.370443:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff945903af2300) 00010000:00010000:2.0:1790784477.370450:0:9249:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790784477.370466:0:9249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3bd9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135092 expref: -99 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790784477.371197:0:9249:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1790784477.371523:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3be0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.371542:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3be0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.371556:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3be0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.371628:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3bd9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135092 expref: 34 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.371649:0:9249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3be0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135092 expref: 33 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.371657:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff945903af2900) 00010000:00010000:2.0:1790784477.371659:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790784477.371663:0:9249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe75200, rc 0) 00000100:00100000:2.0:1790784477.371756:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+33:10441:x1877773344873216:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 1420us (2961us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1790784477.371766:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 72 00000100:00100000:3.0:1790784477.385755:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784477.385890:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344873472 00000100:00100000:0.0:1790784477.385902:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344873472 00000100:00100000:0.0:1790784477.385973:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 73 00000100:00100000:0.0:1790784477.385985:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+33:10441:x1877773344873472:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790784477.386072:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784477.386106:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3be0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135092 expref: 33 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.386130:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff945903af2900) 00010000:00010000:0.0:1790784477.386160:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790784477.386191:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3bee lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.386206:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3bee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.386218:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3bee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.386233:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3bf5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x7333a87f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.386240:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3bf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7333a87f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.386246:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3bf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7333a87f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.386901:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3bee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.386915:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3bee lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.386922:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3bee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.386929:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b1800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784477.386935:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3bee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.386943:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3bee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.386963:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff945903af2300) 00010000:00010000:0.0:1790784477.386966:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784477.386972:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3bee lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.386979:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3bee lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.386992:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3bf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7333a87f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.386999:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3bf5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7333a87f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.387004:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3bf5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7333a87f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.387009:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b0400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784477.387012:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3bf5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7333a87f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.387018:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3bf5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7333a87f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.387025:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x7333a87f (ffff945903a23a00) 00010000:00010000:0.0:1790784477.389971:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784477.389996:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3bf5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7333a87f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.390011:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3bf5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7333a87f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784477.390190:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+32:10441:x1877773344873472:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 Request processed in 4200us (4454us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790784477.390200:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 73 00000100:00100000:3.0:1790784477.396437:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784477.396548:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344873600 00000100:00100000:2.0:1790784477.396560:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344873600 00000100:00100000:2.0:1790784477.396627:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 74 00000100:00100000:2.0:1790784477.396640:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+32:10441:x1877773344873600:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790784477.396665:0:9249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784477.396710:0:9249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3bfc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135099 expref: -99 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.396775:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d3c03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.396793:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d3c03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.396809:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d3c03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.396927:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3bfc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135099 expref: 34 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.396948:0:9249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d3c03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135099 expref: 33 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.396956:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff945903af2100) 00010000:00010000:2.0:1790784477.396960:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790784477.396964:0:9249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe75e00, rc 0) 00000100:00100000:2.0:1790784477.397042:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+33:10441:x1877773344873600:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 404us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784477.397051:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 74 00000100:00100000:0.0:1790784477.407183:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784477.407268:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344873856 00000100:00100000:2.0:1790784477.407281:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344873856 00000100:00100000:2.0:1790784477.407356:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 75 00000100:00100000:2.0:1790784477.407368:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590686bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+33:10441:x1877773344873856:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790784477.407516:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d3c0a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.407553:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d3c0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.407568:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d3c0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790784477.407927:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1790784477.407940:0:5819:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 311557563761ns, next at 312557561031ns, rc = 0 00000004:00010000:2.0:1790784477.408043:0:5819:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ab34fc9 reply state 0000000004d79c98 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d3c0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784477.408054:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790784477.408172:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590686bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+35:10441:x1877773344873856:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 Request processed in 804us (999us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1790784477.408180:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 75 00010000:00010000:2.0:1790784477.414250:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d3c0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.414286:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d3c0a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.414294:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d3c0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.414301:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784477.414307:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d3c0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.414314:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d3c0a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.414355:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff945903af2100) 00010000:00010000:2.0:1790784477.414357:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790784477.414364:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d3c0a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.414370:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d3c0a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784477.416565:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784477.416866:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344873984 00000100:00100000:2.0:1790784477.416878:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344873984 00000100:00100000:2.0:1790784477.416941:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 76 00000100:00100000:2.0:1790784477.416952:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+34:10441:x1877773344873984:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790784477.416986:0:9249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784477.417011:0:9249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3c11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381350a0 expref: -99 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.417103:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3c11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350a0 expref: 35 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.417120:0:9249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3c11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350a0 expref: 35 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.417143:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff945903af2100) 00010000:00010000:2.0:1790784477.417146:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790784477.417151:0:9249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74800, rc 0) 00000100:00100000:2.0:1790784477.417233:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+35:10441:x1877773344873984:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 282us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784477.417269:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 76 00000100:00100000:2.0:1790784477.429490:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784477.429859:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344874112 00000100:00100000:3.0:1790784477.429872:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344874112 00000100:00100000:3.0:1790784477.429934:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 25 00000100:00100000:3.0:1790784477.429944:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f50f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1877773344874112:12345-192.168.206.32@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1790784477.429988:0:6669:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from b0f9e8c2-ddb0-4027-babe-0b166585860c@192.168.206.32@tcp t0 exp 0000000000000000 cur 311 last 0 00000020:00000080:3.0:1790784477.430038:0:6669:0:(genops.c:1384:class_connect()) connect: client b0f9e8c2-ddb0-4027-babe-0b166585860c, cookie 0x2c3a1e2a079d3c18 00002000:00100000:3.0:1790784477.430053:0:6669:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b0f9e8c2-ddb0-4027-babe-0b166585860c/ffff945934917000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790784477.430086:0:6669:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790784477.430411:0:6669:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790784477.430452:0:6669:0:(import.c:65:import_set_state_nolock()) ffff945934916000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790784477.430813:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f50f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2348:x1877773344874112:12345-192.168.206.32@tcp:8:lhsmtool_posix.0 Request processed in 867us (1336us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784477.430823:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 25 00000100:00100000:2.0:1790784477.436805:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784477.444215:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344874240 00000100:00100000:3.0:1790784477.444265:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344874240 00000100:00100000:3.0:1790784477.444358:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 26 00000100:00100000:3.0:1790784477.444371:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f50f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:0:x1877773344874240:12345-192.168.206.32@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1790784477.444722:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790784477.519437:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f50f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:0:x1877773344874240:12345-192.168.206.32@tcp:2:lhsmtool_posix.0 Request processed in 75054us (82631us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1790784477.519454:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 26 00000001:00080000:0.0:1790784477.519756:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:0.0:1790784477.519770:0:7614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b0f9e8c2-ddb0-4027-babe-0b166585860c 00000100:00100000:0.0:1790784477.545879:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784477.546007:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344874496 00000100:00100000:1.0:1790784477.546020:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344874496 00000100:00100000:1.0:1790784477.546206:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 19 00000100:00100000:1.0:1790784477.546218:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+35:10441:x1877773344874496:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790784477.546544:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+36:10441:x1877773344874496:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 Request processed in 327us (678us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1790784477.546554:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 19 00000100:00100000:1.0:1790784477.550164:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784477.557805:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344874752 00000100:00100000:2.0:1790784477.557825:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344874752 00000100:00100000:2.0:1790784477.557939:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 77 00000100:00100000:2.0:1790784477.557952:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+36:10441:x1877773344874752:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790784477.558284:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+36:10441:x1877773344874752:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 Request processed in 334us (8132us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784477.558292:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 77 00000100:00100000:3.0:1790784477.562777:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784477.562869:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344874880 00000100:00100000:0.0:1790784477.562880:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344874880 00000100:00100000:0.0:1790784477.562943:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 78 00000100:00100000:0.0:1790784477.562953:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+36:10441:x1877773344874880:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790784477.562976:0:9249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784477.562998:0:9249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3c1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381350a7 expref: -99 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.563085:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3c26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.563102:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3c26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.563114:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3c26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790784477.563155:0:9249:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790784477.563173:0:9249:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3c26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.563209:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3c1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350a7 expref: 38 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.563226:0:9249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3c26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350a7 expref: 37 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.563234:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff945903af2100) 00010000:00010000:0.0:1790784477.563238:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790784477.563242:0:9249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b1800, rc 0) 00000100:00100000:0.0:1790784477.563313:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+37:10441:x1877773344874880:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 361us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784477.563320:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 78 00000100:00100000:2.0:1790784477.567578:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784477.567986:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344875008 00000100:00100000:3.0:1790784477.568000:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344875008 00000100:00100000:3.0:1790784477.568089:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 27 00000100:00100000:3.0:1790784477.568101:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f50c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2349:x1877773344875008:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790784477.568128:0:6669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784477.568157:0:6669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3c2d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381350ae expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790784477.568193:0:6669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abd33dd, blocks: 0x1 00010000:00010000:3.0:1790784477.568218:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=311s v=(0 0) 00010000:00010000:3.0:1790784477.568224:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784477.568235:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3c2d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350ae expref: 6 pid: 6669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.568263:0:6669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3c2d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350ae expref: 6 pid: 6669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.568279:0:6669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945901525a00, rc 0) 00000100:00100000:3.0:1790784477.568370:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f50c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2349:x1877773344875008:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 272us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784477.568408:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 27 00000100:00100000:0.0:1790784477.604201:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784477.604544:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344875264 00000100:00100000:1.0:1790784477.604557:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344875264 00000100:00100000:1.0:1790784477.604620:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 79 00000100:00100000:1.0:1790784477.604632:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590686b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+37:10441:x1877773344875264:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790784477.604798:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590686b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+37:10441:x1877773344875264:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 Request processed in 168us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784477.604807:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 79 00000100:00100000:3.0:1790784477.616126:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784477.616244:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344875392 00000100:00100000:0.0:1790784477.616268:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344875392 00000100:00100000:0.0:1790784477.616343:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 28 00000100:00100000:0.0:1790784477.616355:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:10441:x1877773344875392:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790784477.616411:0:6668:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784477.616439:0:6668:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d3c34 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381350b5 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.616484:0:6668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3c2d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350ae expref: 7 pid: 6669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.616497:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790784477.616502:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790784477.616528:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d3c34 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350b5 expref: 7 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.616582:0:6668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3c2d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350ae expref: 7 pid: 6669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.616600:0:6668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3c2d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350ae expref: 7 pid: 6669 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784477.616619:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906869c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6668:1877773359577728:192.168.206.32@tcp:104: 00000100:00100000:0.0:1790784477.616996:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593fe4a480 going to sleep for 11 seconds 00000100:00100000:3.0:1790784477.619435:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906869c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6668:1877773359577728:192.168.206.32@tcp:104: 00010000:00010000:3.0:1790784477.619487:0:6668:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d3c34 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350b5 expref: 7 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.619513:0:6668:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b0400, rc 0) 00000100:00100000:3.0:1790784477.619584:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:10441:x1877773344875392:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 3230us (3472us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784477.619594:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 28 00000100:00100000:3.0:1790784477.620294:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784477.621094:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344875520 00000100:00100000:2.0:1790784477.621107:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344875520 00010000:00010000:2.0:1790784477.621157:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3c2d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350ae expref: 7 pid: 6669 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784477.621203:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 42 00000100:00100000:2.0:1790784477.621213:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905195c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2352:x1877773344875520:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790784477.621230:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784477.621862:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3c2d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350ae expref: 7 pid: 6669 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.621882:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3c2d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350ae expref: 7 pid: 6669 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.621940:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3c2d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350ae expref: 7 pid: 6669 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.621974:0:5804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790784477.621980:0:5804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790784477.621990:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d3c34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350b5 expref: 6 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.622002:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d3c34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350b5 expref: 6 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.622053:0:5804:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d3c34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350b5 expref: 6 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784477.622071:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f50e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5804:1877773359577856:192.168.206.32@tcp:105: 00000100:00100000:2.0:1790784477.622182:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff945902b916c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790784477.627286:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906bea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359577984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790784477.627424:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784477.627709:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359577984 00000100:00100000:1.0:1790784477.627718:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359577984 00000100:00100000:1.0:1790784477.627803:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790784477.627817:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1877773359577984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790784477.627860:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790784477.627920:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1877773359577984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784477.627927:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1790784477.628055:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790784477.628197:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906bea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359577984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790784477.631633:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359578112:0@lo:400:kworker.0 00000100:00100000:0.0:1790784477.631739:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784477.631786:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359578624:0@lo:400:kworker.0 00000100:00100000:0.0:1790784477.631818:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784477.631848:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790784477.631853:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f495f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1877773359578496:0@lo:400:kworker.0 00000100:00100000:0.0:1790784477.631878:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784477.631911:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359578112 00000100:00100000:0.0:1790784477.631920:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359578112 00000100:00100000:0.0:1790784477.631974:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1790784477.631984:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3282:x1877773359578112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784477.632038:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3282:x1877773359578112:12345-0@lo:400:kworker.0 Request processed in 55us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784477.632046:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1790784477.632084:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359578624 00000100:00100000:0.0:1790784477.632097:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359578624 00000100:00100000:0.0:1790784477.632138:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790784477.632145:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359578624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784477.632179:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359578624:12345-0@lo:400:kworker.0 Request processed in 34us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784477.632185:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790784477.632205:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359578496 00000100:00100000:0.0:1790784477.632208:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359578496 00000100:00100000:0.0:1790784477.632237:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1790784477.632244:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1877773359578496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784477.632273:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1877773359578496:12345-0@lo:400:kworker.0 Request processed in 30us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784477.632278:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:0.0:1790784477.632298:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790784477.632303:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790784477.632343:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f495f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1877773359578496:0@lo:400:kworker.0 00000100:00100000:0.0:1790784477.632354:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359578112:0@lo:400:kworker.0 00000100:00100000:0.0:1790784477.632365:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359578624:0@lo:400:kworker.0 00000100:00100000:0.0:1790784477.632751:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1877773359578240:0@lo:400:kworker.0 00000100:00100000:0.0:1790784477.632800:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784477.632829:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790784477.632835:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359578368:0@lo:400:kworker.0 00000100:00100000:0.0:1790784477.632858:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784477.632883:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359578240 00000100:00100000:0.0:1790784477.632888:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359578240 00000100:00100000:0.0:1790784477.632915:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359578368 00000100:00100000:0.0:1790784477.632929:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359578368 00000100:00100000:0.0:1790784477.632970:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790784477.632979:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906869500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1877773359578240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784477.633020:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906869500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1877773359578240:12345-0@lo:400:kworker.0 Request processed in 44us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784477.633027:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790784477.633040:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1790784477.633047:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359578368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784477.633074:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359578368:12345-0@lo:400:kworker.0 Request processed in 28us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784477.633080:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:0.0:1790784477.633096:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790784477.633120:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359578368:0@lo:400:kworker.0 00000100:00100000:0.0:1790784477.633130:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1877773359578240:0@lo:400:kworker.0 00000100:00100000:0.0:1790784477.635452:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784477.635591:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f50e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5804:1877773359577856:192.168.206.32@tcp:105: 00010000:00010000:1.0:1790784477.635622:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790784477.635685:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905195c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2352:x1877773344875520:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 14473us (15395us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784477.635697:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 42 00000100:00100000:3.0:1790784477.636706:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344875648 00000100:00100000:3.0:1790784477.636721:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344875648 00002000:00100000:3.0:1790784477.636803:0:6675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff945906868a80 x1877773344875648/t0(0) o4->b0f9e8c2-ddb0-4027-babe-0b166585860c@192.168.206.32@tcp:743/0 lens 504/0 e 0 to 0 dl 1790784488 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790784477.636814:0:6675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff945906868a80 with x1877773344875648 ext(0->8) 00002000:00010000:3.0:1790784477.636821:0:6675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945906868a80 00000100:00100000:3.0:1790784477.636852:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 0 00000100:00100000:3.0:1790784477.636863:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2351:x1877773344875648:12345-192.168.206.32@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1790784477.642972:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:2351:x1877773344875648:12345-192.168.206.32@tcp:4:lhsmtool_posix.0 Request processed in 6103us (7527us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1790784477.642986:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 0 00002000:00100000:3.0:1790784477.642996:0:6675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff945906868a80 x1877773344875648/t4294967302(0) o4->b0f9e8c2-ddb0-4027-babe-0b166585860c@192.168.206.32@tcp:743/0 lens 504/448 e 0 to 0 dl 1790784488 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790784477.643007:0:6675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff945906868a80 with x1877773344875648 ext(0->8) 00002000:00010000:3.0:1790784477.643983:0:6675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945906868a80 00000100:00100000:0.0:1790784477.651685:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784477.651776:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344875776 00000100:00100000:3.0:1790784477.651787:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344875776 00000100:00100000:3.0:1790784477.651851:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 80 00000100:00100000:3.0:1790784477.651863:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590686a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+37:10441:x1877773344875776:12345-192.168.206.32@tcp:44:lhsmtool_posix.0 00010000:00010000:3.0:1790784477.698912:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790784477.740269:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000001:00080000:1.0:1790784477.740302:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1790784477.740312:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1790784477.740334:0:5841:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:3.0:1790784477.740577:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590686a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+13:10441:x1877773344875776:12345-192.168.206.32@tcp:44:lhsmtool_posix.0 Request processed in 88710us (88894us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784477.740591:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 80 00000020:00080000:2.0:1790784477.741251:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1790784477.741265:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1790784477.742283:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f495c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359578752:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1790784477.742368:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784477.742662:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359578752 00000100:00100000:1.0:1790784477.742672:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359578752 00000100:00100000:1.0:1790784477.742742:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790784477.742753:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359578752:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1790784477.743037:0:6670:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1790784477.743042:0:6670:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790784477 00002000:00010000:1.0:1790784477.743062:0:6670:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790784477.743064:0:6670:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1790784477 -> 1790784477 00002000:00010000:1.0:1790784477.743067:0:6670:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1790784477.743780:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3279:x1877773359578752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1024us (1407us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1790784477.743792:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:3.0:1790784477.743895:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94593f495c00/2, rc 0, transno 4294967303 00000100:00100000:3.0:1790784477.743902:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f495c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359578752:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1790784477.744682:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784477.744830:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344875904 00000100:00100000:3.0:1790784477.744840:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344875904 00000100:00100000:3.0:1790784477.744929:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 30 00000100:00100000:3.0:1790784477.744940:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906869c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:2352:x1877773344875904:12345-192.168.206.32@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1790784477.848185:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1790784477.849206:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1790784477.850408:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906869c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2352:x1877773344875904:12345-192.168.206.32@tcp:16:lhsmtool_posix.0 Request processed in 105458us (105718us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784477.850431:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 30 00000100:00100000:0.0:1790784477.859533:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784477.859646:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344876160 00000100:00100000:3.0:1790784477.859658:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344876160 00000100:00100000:3.0:1790784477.859737:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 81 00000100:00100000:3.0:1790784477.859750:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+13:10441:x1877773344876160:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790784477.859822:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784477.859855:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d3c26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350a7 expref: 13 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.859878:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff945903af2100) 00010000:00010000:3.0:1790784477.859884:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790784477.859918:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3c3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.859934:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3c3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.859945:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3c3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790784477.860506:0:5820:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000adeb8b89 reply state 000000006939436b transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3c3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784477.860521:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790784477.860639:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+14:10441:x1877773344876160:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 Request processed in 890us (1118us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1790784477.860647:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 81 00000100:00100000:0.0:1790784477.864042:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784477.864613:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344876288 00000100:00100000:1.0:1790784477.864626:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344876288 00000100:00100000:1.0:1790784477.864695:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 31 00000100:00100000:1.0:1790784477.864706:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d4c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2351:x1877773344876288:12345-192.168.206.32@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1790784477.865250:0:6668:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1790784477.865256:0:6668:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1790784477 -> 1790784476 00002000:00010000:1.0:1790784477.865259:0:6668:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790784474 00002000:00010000:1.0:1790784477.865261:0:6668:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1790784477 -> 1790784476 00002000:00010000:1.0:1790784477.865264:0:6668:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1790784477.865372:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d4c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2351:x1877773344876288:12345-192.168.206.32@tcp:2:lhsmtool_posix.0 Request processed in 665us (1342us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1790784477.865412:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 31 00010000:00010000:3.0:1790784477.865549:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3c3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.865575:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3c3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.865583:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3c3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.865589:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901525e00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784477.865595:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3c3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.865603:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3c3b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.865620:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff945903af2100) 00010000:00010000:3.0:1790784477.865624:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784477.865629:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3c3b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.865636:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3c3b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784477.874563:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784477.874648:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344876544 00000100:00100000:2.0:1790784477.874660:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344876544 00000100:00100000:2.0:1790784477.874783:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 82 00000100:00100000:2.0:1790784477.874796:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906bebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+13:10441:x1877773344876544:12345-192.168.206.32@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1790784477.874885:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3c42 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.874916:0:9249:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d3c03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135099 expref: 13 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.874926:0:9249:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3c42 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.875173:0:9249:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d3c03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135099 expref: 13 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.875190:0:9249:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d3c03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135099 expref: 13 pid: 9249 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784477.875206:0:9249:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f50d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9249:1877773359578880:192.168.206.32@tcp:104: 00000100:00100000:2.0:1790784477.875326:0:9249:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459181226c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790784477.881664:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784477.881787:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344876672 00000100:00100000:1.0:1790784477.881800:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344876672 00010000:00010000:1.0:1790784477.881859:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d3c03 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135099 expref: 14 pid: 9249 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784477.881910:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 43 00000100:00100000:1.0:1790784477.881922:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+14:2351:x1877773344876672:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790784477.881939:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784477.881954:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d3c03 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135099 expref: 14 pid: 9249 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784477.881979:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d3c03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135099 expref: 14 pid: 9249 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784477.882010:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff945903af2100) 00010000:00010000:1.0:1790784477.882016:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3c42 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784477.882027:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3c42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784477.882037:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3c42 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784477.882062:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790784477.882581:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d3c03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135099 expref: 14 pid: 9249 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784477.882606:0:9249:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f50d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9249:1877773359578880:192.168.206.32@tcp:104: 00010000:00010000:3.0:1790784477.882633:0:9249:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3c42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.882644:0:9249:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3c42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.882664:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3c42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.882700:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3c42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.882708:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3c42 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.882716:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3c42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.882722:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75200 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784477.882738:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3c42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.882747:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3c42 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.882766:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff945903af2100) 00010000:00010000:3.0:1790784477.882769:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1790784477.882774:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3c42 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.882781:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3c42 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784477.883035:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+13:2351:x1877773344876672:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 1112us (1384us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784477.883046:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 43 00000100:00100000:3.0:1790784477.885329:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906bebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+12:10441:x1877773344876544:12345-192.168.206.32@tcp:55:lhsmtool_posix.0 Request processed in 10520us (10761us total) trans 0 rc -22/-22 00000100:00100000:3.0:1790784477.885345:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 82 00000100:00100000:3.0:1790784477.893153:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784477.893244:0:8181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344876800 00000100:00100000:2.0:1790784477.893257:0:8181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344876800 00000100:00100000:2.0:1790784477.893332:0:8181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 32 00000100:00100000:2.0:1790784477.893345:0:8181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2351:x1877773344876800:12345-192.168.206.32@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1790784477.893448:0:8181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006b640d89/0x2c3a1e2a079d3c49 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.893474:0:8181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d3c34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350b5 expref: 7 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.893484:0:8181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1790784477.893490:0:8181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790784477.893508:0:8181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b640d89/0x2c3a1e2a079d3c49 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.893552:0:8181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d3c34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350b5 expref: 7 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.893567:0:8181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d3c34 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350b5 expref: 7 pid: 6668 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784477.893584:0:8181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f50e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8181:1877773359579008:192.168.206.32@tcp:104: 00000100:00100000:2.0:1790784477.893678:0:8181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459181226c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790784477.903591:0:8181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f50e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8181:1877773359579008:192.168.206.32@tcp:104: 00000100:00100000:1.0:1790784477.903593:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00010000:00010000:2.0:1790784477.903625:0:8181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006b640d89/0x2c3a1e2a079d3c49 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784477.904149:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344876928 00000100:00100000:3.0:1790784477.904160:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344876928 00010000:00010000:3.0:1790784477.904210:0:8480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d3c34 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350b5 expref: 8 pid: 6668 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784477.904262:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 44 00000100:00100000:3.0:1790784477.904273:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906bea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:2352:x1877773344876928:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790784477.904291:0:8480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784477.904319:0:8480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d3c34 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350b5 expref: 8 pid: 6668 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.904333:0:8480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d3c34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350b5 expref: 8 pid: 6668 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.904363:0:8480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d3c34 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350b5 expref: 8 pid: 6668 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.904419:0:8480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790784477.904425:0:8480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790784477.904431:0:8480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b640d89/0x2c3a1e2a079d3c49 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.904443:0:8480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b640d89/0x2c3a1e2a079d3c49 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.904467:0:8480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790784477.904553:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906bea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2352:x1877773344876928:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 281us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784477.904562:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 44 00010000:00010000:2.0:1790784477.904856:0:8181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006b640d89/0x2c3a1e2a079d3c49 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.904867:0:8181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b640d89/0x2c3a1e2a079d3c49 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.904899:0:8181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006b640d89/0x2c3a1e2a079d3c49 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.904908:0:8181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b640d89/0x2c3a1e2a079d3c49 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.904930:0:8181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b640d89/0x2c3a1e2a079d3c49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.904938:0:8181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74e00 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:2.0:1790784477.904943:0:8181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b640d89/0x2c3a1e2a079d3c49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.904953:0:8181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b640d89/0x2c3a1e2a079d3c49 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.904979:0:8181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b640d89/0x2c3a1e2a079d3c49 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.904987:0:8181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b640d89/0x2c3a1e2a079d3c49 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784477.905063:0:8181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2351:x1877773344876800:12345-192.168.206.32@tcp:1:lhsmtool_posix.0 Request processed in 11720us (11923us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784477.905072:0:8181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 32 00000100:00100000:1.0:1790784477.910145:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784477.910337:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344877184 00000100:00100000:0.0:1790784477.910350:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344877184 00000100:00100000:0.0:1790784477.910446:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 83 00000100:00100000:0.0:1790784477.910458:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+12:10441:x1877773344877184:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790784477.910588:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3c50 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.910609:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3c50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.910624:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3c50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.911248:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d3c57 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.911268:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3c11 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350a0 expref: 13 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.911277:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d3c57 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.911321:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3c11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350a0 expref: 13 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.911340:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3c11 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350a0 expref: 13 pid: 9249 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784477.911356:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459056daa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5818:1877773359579136:192.168.206.32@tcp:104: 00000100:00100000:0.0:1790784477.911495:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593fe4ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1790784477.914566:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784477.914677:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344877312 00000100:00100000:1.0:1790784477.914690:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344877312 00010000:00010000:1.0:1790784477.914755:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3c11 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350a0 expref: 14 pid: 9249 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784477.914814:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 45 00000100:00100000:1.0:1790784477.914825:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f495500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+14:2351:x1877773344877312:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790784477.914863:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784477.914872:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3c11 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350a0 expref: 14 pid: 9249 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784477.914886:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3c11 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350a0 expref: 14 pid: 9249 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784477.914911:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff945903af2100) 00010000:00010000:1.0:1790784477.914918:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d3c57 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784477.914929:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d3c57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784477.914938:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d3c57 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784477.914973:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790784477.915041:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f495500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+14:2351:x1877773344877312:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 216us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784477.915049:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 45 00010000:00010000:0.0:1790784477.915391:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3c11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350a0 expref: 13 pid: 9249 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784477.915413:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459056daa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5818:1877773359579136:192.168.206.32@tcp:104: 00010000:00010000:0.0:1790784477.915450:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d3c57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.915461:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d3c57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.915466:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d3c57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790784477.915711:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1790784477.915894:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1790784477.915944:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1790784477.916064:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459056daa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5818:1877773359579264:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790784477.917367:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784477.917438:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593fe4ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1790784477.919219:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359579264 00000100:00100000:3.0:1790784477.919237:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359579264 00000100:00100000:3.0:1790784477.919310:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790784477.919322:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5818:x1877773359579264:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1790784477.919488:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5818:x1877773359579264:12345-0@lo:1000:mdt00_000.0 Request processed in 168us (2127us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784477.919496:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790784477.919551:0:5818:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1790784477.919558:0:5818:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94593f495c00, transno 4294967303 00000100:00100000:3.0:1790784477.919574:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459056daa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5818:1877773359579264:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1790784477.920181:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1790784477.920286:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f495180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5818:1877773359579392:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1790784477.920341:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784477.920400:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459051ad780 going to sleep for 11 seconds 00000100:00100000:3.0:1790784477.920633:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359579392 00000100:00100000:3.0:1790784477.920640:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359579392 00000100:00100000:3.0:1790784477.920677:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790784477.920685:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5818:x1877773359579392:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1790784477.920899:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5818:x1877773359579392:12345-0@lo:1000:mdt00_000.0 Request processed in 213us (557us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1790784477.920907:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790784477.920952:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f495180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5818:1877773359579392:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1790784477.921008:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d3c57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.921020:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d3c57 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.921029:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d3c57 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.921035:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b0c00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784477.921040:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d3c57 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.921049:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d3c57 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.921067:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff945903af2100) 00010000:00010000:3.0:1790784477.921070:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790784477.921075:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d3c57 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.921082:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d3c57 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.921127:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d3b8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.921134:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d3b8c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.921140:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d3b8c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.921154:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784477.921158:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d3b8c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.921163:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d3b8c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.921171:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff945903af2400) 00010000:00010000:3.0:1790784477.921173:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790784477.921177:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d3b8c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.921182:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d3b8c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.921208:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c5e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.921223:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d3ba8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135084 expref: 16 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.921233:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c5e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.921265:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d3ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135084 expref: 16 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.921282:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d3ba8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135084 expref: 16 pid: 5820 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784477.921307:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f495c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5818:1877773359579520:192.168.206.32@tcp:104: 00000100:00100000:3.0:1790784477.921414:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459051ad780 going to sleep for 11 seconds 00000100:00100000:2.0:1790784477.933264:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784477.933304:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344877440 00000100:00100000:2.0:1790784477.933314:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344877440 00010000:00010000:2.0:1790784477.933364:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d3ba8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135084 expref: 17 pid: 5820 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784477.933442:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 46 00000100:00100000:2.0:1790784477.933452:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f50e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+17:2352:x1877773344877440:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790784477.933472:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784477.933479:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d3ba8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135084 expref: 17 pid: 5820 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.933493:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d3ba8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135084 expref: 17 pid: 5820 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.933519:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff945903af2400) 00010000:00010000:2.0:1790784477.933525:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c5e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.933536:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.933544:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c5e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784477.933566:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790784477.933626:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f50e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+17:2352:x1877773344877440:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 175us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784477.933634:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 46 00010000:00010000:3.0:1790784477.934904:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d3ba8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135084 expref: 16 pid: 5820 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784477.934931:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f495c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5818:1877773359579520:192.168.206.32@tcp:104: 00010000:00010000:3.0:1790784477.934968:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.934979:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.934985:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.935001:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.935007:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c5e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.935014:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c5e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.935020:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901524800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784477.935024:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c5e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.935032:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c5e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.935063:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff945903af2400) 00010000:00010000:3.0:1790784477.935066:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784477.935072:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c5e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.935078:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c5e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.935307:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3c50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.935315:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3c50 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.935320:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3c50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.935325:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b0200 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784477.935328:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3c50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.935332:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3c50 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.935341:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff945903af2400) 00010000:00010000:3.0:1790784477.935344:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790784477.935346:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3c50 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.935352:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3c50 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784477.935670:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+15:10441:x1877773344877184:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 Request processed in 25211us (25534us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1790784477.935682:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 83 00000020:00080000:3.0:1790784477.935689:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1790784477.937676:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784477.937719:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344877696 00000100:00100000:3.0:1790784477.937740:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344877696 00000100:00100000:3.0:1790784477.937810:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 20 00000100:00100000:3.0:1790784477.937821:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+15:10441:x1877773344877696:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 00000040:00080000:2.0:1790784477.938556:0:11656:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790784477.938565:0:11656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790784477.938600:0:11656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1790784477.938607:0:11656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000004:00080000:3.0:1790784477.940366:0:5822:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1790784477.940672:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1790784477.940873:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3c65 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.940895:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3c65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.940909:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3c65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.940918:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3c65 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.940925:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3c65 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784477.940932:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3c65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.942151:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790784477.942164:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3c65 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.942174:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901525e00 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:0.0:1790784477.942179:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3c65 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.942191:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3c65 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.942208:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94592012a200) 00010000:00010000:0.0:1790784477.942211:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790784477.942217:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3c65 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784477.942226:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784477.942238:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784477.942240:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784477.942456:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790784477.942465:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3c65 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784477.942627:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+17:10441:x1877773344877696:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 Request processed in 4802us (4959us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1790784477.942639:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 20 00000020:00080000:3.0:1790784477.942646:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:2.0:1790784478.000164:0:11969:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790784478.000177:0:11969:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790784478.000225:0:11969:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1790784478.000231:0:11969:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790784478.139023:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593fe4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359579648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790784478.139115:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784478.139406:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359579648 00000100:00100000:1.0:1790784478.139416:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359579648 00000100:00100000:1.0:1790784478.139477:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790784478.139489:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f50d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1877773359579648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790784478.139518:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1790784478.139579:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f50d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1877773359579648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784478.139602:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790784478.139661:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593fe4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359579648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790784478.183677:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784478.183842:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344877952 00000100:00100000:0.0:1790784478.183860:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344877952 00000100:00100000:0.0:1790784478.183978:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 84 00000100:00100000:0.0:1790784478.183992:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+17:10451:x1877773344877952:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:0.0:1790784478.184021:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784478.184049:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d3c6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381350bc expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784478.184183:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0000/0x2c3a1e2a079d3c73 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784478.184201:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0000/0x2c3a1e2a079d3c73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784478.184215:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0000/0x2c3a1e2a079d3c73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790784478.184227:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1790784478.184412:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d3c6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350bc expref: 20 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784478.184433:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0000/0x2c3a1e2a079d3c73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350bc expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784478.184441:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff945903af2300) 00010000:00010000:0.0:1790784478.184444:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790784478.184448:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b0000, rc 0) 00000100:00100000:0.0:1790784478.184526:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+19:10451:x1877773344877952:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 538us (857us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1790784478.184553:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 84 00000100:00080000:1.0:1790784478.185119:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790784478.201832:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784478.202350:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344878080 00000100:00100000:3.0:1790784478.202365:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344878080 00000100:00100000:3.0:1790784478.202467:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 85 00000100:00100000:3.0:1790784478.202479:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fe4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+19:10451:x1877773344878080:12345-192.168.206.32@tcp:34:lfs.0 00010000:00010000:3.0:1790784478.202577:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3c81 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.202598:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3c81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.202612:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3c81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.202627:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.202635:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.202643:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.202952:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3c8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.202975:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3c8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.202983:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3c8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790784478.203032:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3c8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.203047:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3c81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.203054:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3c81 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.203061:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3c81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.203067:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901525e00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784478.203072:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3c81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.203080:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3c81 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.203092:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff945903af2300) 00010000:00010000:3.0:1790784478.203095:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784478.203100:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3c81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.203113:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3c81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.203130:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.203135:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.203140:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.203145:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901524800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784478.203148:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.203154:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.203161:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94592012a200) 00010000:00010000:3.0:1790784478.203164:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784478.203167:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c88 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.203174:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.203191:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3c8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.203198:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3c8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.203211:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3c8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.203216:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901525a00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784478.203219:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3c8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.203225:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3c8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.203233:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a800) 00010000:00010000:3.0:1790784478.203235:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784478.203238:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3c8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.203244:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3c8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784478.203352:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fe4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+19:10451:x1877773344878080:12345-192.168.206.32@tcp:34:lfs.0 Request processed in 871us (1531us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784478.203360:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 85 00000100:00100000:0.0:1790784478.299912:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784478.300019:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344878336 00000100:00100000:3.0:1790784478.300040:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344878336 00000100:00100000:3.0:1790784478.300110:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 86 00000100:00100000:3.0:1790784478.300122:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+19:10454:x1877773344878336:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:3.0:1790784478.300149:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784478.300182:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3c96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381350c3 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.300292:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c9d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.300310:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.300323:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.300340:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3ca4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.300348:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.300356:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.300704:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3cab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.300714:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3cab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.300734:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3cab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790784478.300746:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1790784478.300855:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.300864:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c9d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.300878:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.300889:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901524800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784478.300895:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.300903:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c9d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.300916:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff945903af2300) 00010000:00010000:3.0:1790784478.300920:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784478.300925:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.300931:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3c9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.300946:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.300952:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3ca4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.300957:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.300962:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901525e00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784478.300965:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.300984:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3ca4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.300992:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94592012a800) 00010000:00010000:3.0:1790784478.300995:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784478.300998:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3ca4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.301004:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3ca4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.301058:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3c96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350c3 expref: 22 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.301074:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3cab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350c3 expref: 21 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.301082:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a200) 00010000:00010000:3.0:1790784478.301084:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790784478.301086:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945901524600, rc 0) 00000100:00100000:3.0:1790784478.301165:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+21:10454:x1877773344878336:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 1046us (1267us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1790784478.301174:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 86 00000100:00100000:3.0:1790784478.305781:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784478.305867:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344878464 00000100:00100000:0.0:1790784478.305879:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344878464 00000100:00100000:0.0:1790784478.305966:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 87 00000100:00100000:0.0:1790784478.305979:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+21:10454:x1877773344878464:12345-192.168.206.32@tcp:54:lfs.0 00010000:00010000:0.0:1790784478.306067:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d3cb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784478.306086:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d3cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784478.306100:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d3cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784478.306132:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d3cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784478.306139:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d3cb9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784478.306147:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d3cb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784478.306152:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b0800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784478.306157:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d3cb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784478.306165:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d3cb9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784478.306195:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a200) 00010000:00010000:0.0:1790784478.306198:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790784478.306205:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d3cb9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784478.306212:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d3cb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784478.306311:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+21:10454:x1877773344878464:12345-192.168.206.32@tcp:54:lfs.0 Request processed in 334us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784478.306318:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 87 00000100:00100000:3.0:1790784478.311768:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784478.316325:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344878720 00000100:00100000:0.0:1790784478.316346:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344878720 00000100:00100000:0.0:1790784478.316442:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 21 00000100:00100000:0.0:1790784478.316454:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc17450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+21:10454:x1877773344878720:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:0.0:1790784478.316761:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc17450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+22:10454:x1877773344878720:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 308us (5014us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1790784478.316770:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 21 00000100:00100000:3.0:1790784478.377183:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784478.377255:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344878976 00000100:00100000:1.0:1790784478.377274:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344878976 00000100:00100000:1.0:1790784478.377360:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 88 00000100:00100000:1.0:1790784478.377406:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+22:9985:x1877773344878976:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:1.0:1790784478.377440:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784478.377465:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d3cc0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381350ca expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.377596:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d3cc7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.377614:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3cab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350c3 expref: 23 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.377624:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d3cc7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.377668:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3cab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350c3 expref: 23 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.377690:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3cab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350c3 expref: 23 pid: 5819 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784478.377706:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593fe4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5819:1877773359579776:192.168.206.32@tcp:104: 00000100:00100000:1.0:1790784478.377853:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910ff9000 going to sleep for 11 seconds 00000100:00100000:1.0:1790784478.385240:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593fe4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5819:1877773359579776:192.168.206.32@tcp:104: 00010000:00010000:1.0:1790784478.385282:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d3cc7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784478.385317:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784478.385521:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344879104 00000100:00100000:1.0:1790784478.385532:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344879104 00010000:00010000:1.0:1790784478.385584:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3cab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350c3 expref: 24 pid: 5819 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784478.385634:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 47 00000100:00100000:1.0:1790784478.385647:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f496300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+24:2352:x1877773344879104:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790784478.385668:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784478.385676:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3cab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350c3 expref: 24 pid: 5819 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.385693:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3cab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350c3 expref: 24 pid: 5819 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.385733:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3cab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350c3 expref: 24 pid: 5819 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.385761:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a200) 00010000:00010000:1.0:1790784478.385766:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d3cc7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.385777:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d3cc7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.385797:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d3cc7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.385824:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790784478.385890:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f496300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+23:2352:x1877773344879104:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 247us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784478.385898:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 47 00010000:00010000:1.0:1790784478.385928:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d3cc7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.385934:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d3cc7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790784478.385955:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1790784478.386427:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d3cc0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350ca expref: 24 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.386450:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d3cc7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350ca expref: 23 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.386459:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a200) 00010000:00010000:1.0:1790784478.386463:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790784478.386466:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945900030e00, rc 0) 00000100:00100000:1.0:1790784478.386500:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+23:9985:x1877773344878976:12345-192.168.206.32@tcp:101:bash.0 Request processed in 9130us (9325us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1790784478.386508:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 88 00000100:00100000:3.0:1790784478.392225:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784478.392736:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344879360 00000100:00100000:1.0:1790784478.392754:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344879360 00000100:00100000:1.0:1790784478.392854:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 89 00000100:00100000:1.0:1790784478.392865:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+23:9985:x1877773344879360:12345-192.168.206.32@tcp:36:bash.0 00010000:00010000:1.0:1790784478.393258:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d3cd5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.393281:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d3cd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.393296:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d3cd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790784478.393409:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1790784478.393446:0:5820:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000272a2cbe reply state 000000003538f127 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d3cd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784478.393457:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1790784478.393528:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1790784478.393677:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+27:9985:x1877773344879360:12345-192.168.206.32@tcp:36:bash.0 Request processed in 811us (1457us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1790784478.393686:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 89 00000020:00080000:1.0:1790784478.393693:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1790784478.395586:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d3cd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.395601:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d3cd5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.395609:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d3cd5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.395615:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030c00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784478.395620:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d3cd5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.395639:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d3cd5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.395655:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a200) 00010000:00010000:1.0:1790784478.395658:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784478.395664:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d3cd5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.395670:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d3cd5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784478.397096:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784478.397275:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344879488 00000100:00100000:1.0:1790784478.397287:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344879488 00000100:00100000:1.0:1790784478.397346:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 90 00000100:00100000:1.0:1790784478.397356:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+26:9985:x1877773344879488:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:1.0:1790784478.397401:0:9249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784478.397419:0:9249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d3cdc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381350d1 expref: -99 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.397473:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d3cdc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350d1 expref: 27 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.397487:0:9249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d3cdc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350d1 expref: 27 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.397504:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a200) 00010000:00010000:1.0:1790784478.397507:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790784478.397510:0:9249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945900030000, rc 0) 00000100:00100000:1.0:1790784478.397576:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+27:9985:x1877773344879488:12345-192.168.206.32@tcp:101:bash.0 Request processed in 222us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784478.397583:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 90 00000100:00100000:3.0:1790784478.400981:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784478.401672:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344879616 00000100:00100000:0.0:1790784478.401688:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344879616 00000100:00100000:1.0:1790784478.401856:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 33 00000100:00100000:1.0:1790784478.401871:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:9985:x1877773344879616:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:1.0:1790784478.401889:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784478.401909:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000176e798a/0x2c3a1e2a079d3ce3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381350d8 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790784478.401934:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6abd33dc, atime: 0x6abd33da, ctime: 0x6abd33dc, blocks: 0xb 00010000:00010000:1.0:1790784478.401954:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=312s v=(0 0) 00010000:00010000:1.0:1790784478.401959:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784478.401967:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000176e798a/0x2c3a1e2a079d3ce3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350d8 expref: 7 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.401982:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000176e798a/0x2c3a1e2a079d3ce3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350d8 expref: 7 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.401994:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945900031c00, rc 0) 00000100:00100000:1.0:1790784478.402056:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:9985:x1877773344879616:12345-192.168.206.32@tcp:101:bash.0 Request processed in 190us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784478.402063:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 33 00000100:00100000:3.0:1790784478.409173:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784478.409245:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344879744 00000100:00100000:1.0:1790784478.409257:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344879744 00002000:00010000:1.0:1790784478.409297:0:6673:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1790784478.409301:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94593f497100 with x1877773344879744 ext(0->18446744073709551615) 00002000:00010000:1.0:1790784478.409323:0:6673:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94593f497100. 00000100:00100000:1.0:1790784478.409357:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 1 00000100:00100000:1.0:1790784478.409366:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2350:x1877773344879744:12345-192.168.206.32@tcp:10:bash.0 00002000:00010000:1.0:1790784478.409695:0:6673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1790784478.409699:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1790784476 -> 1790784478 00002000:00010000:1.0:1790784478.409702:0:6673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1790784474 -> 1790784474 00002000:00010000:1.0:1790784478.409704:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1790784476 -> 1790784478 00002000:00010000:1.0:1790784478.409706:0:6673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1790784478.410014:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:2350:x1877773344879744:12345-192.168.206.32@tcp:10:bash.0 Request processed in 647us (853us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1790784478.410022:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 1 00002000:00010000:1.0:1790784478.410026:0:6673:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1790784478.410028:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94593f497100 with x1877773344879744 ext(0->18446744073709551615) 00002000:00010000:1.0:1790784478.410033:0:6673:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94593f497100. 00000100:00100000:0.0:1790784478.504847:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784478.506899:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344879872 00000100:00100000:3.0:1790784478.506919:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344879872 00000100:00100000:3.0:1790784478.507329:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 91 00000100:00100000:3.0:1790784478.507345:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+27:10468:x1877773344879872:12345-192.168.206.32@tcp:34:lfs.0 00010000:00010000:3.0:1790784478.507470:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3cea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.507491:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3cea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.507506:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3cea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.507523:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3cf1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.507530:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.507536:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.507909:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3cf8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.507920:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.507928:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790784478.508115:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.508130:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3cea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.508137:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3cea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.508146:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3cea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.508153:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901524000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784478.508157:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3cea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.508165:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3cea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.508331:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff945903af2300) 00010000:00010000:3.0:1790784478.508334:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784478.508341:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3cea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.508347:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3cea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.508366:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.508435:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3cf1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.508451:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3cf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.508456:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901525a00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784478.508459:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3cf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.508466:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3cf1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.508474:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94592012a800) 00010000:00010000:3.0:1790784478.508476:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784478.508480:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3cf1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.508486:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3cf1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.508504:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.508512:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3cf8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.508519:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3cf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.508524:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901525e00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784478.508527:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3cf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.508544:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3cf8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.508553:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a200) 00010000:00010000:3.0:1790784478.508555:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784478.508559:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3cf8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.508566:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3cf8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784478.508665:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+27:10468:x1877773344879872:12345-192.168.206.32@tcp:34:lfs.0 Request processed in 1321us (3829us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784478.508676:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 91 00000100:00100000:3.0:1790784478.558595:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784478.559332:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344880128 00000100:00100000:1.0:1790784478.559346:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344880128 00000100:00100000:1.0:1790784478.559461:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 92 00000100:00100000:1.0:1790784478.559474:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+27:10471:x1877773344880128:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:1.0:1790784478.559501:0:9249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784478.559527:0:9249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d3cff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381350df expref: -99 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.559624:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d3d06 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.559641:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d3d06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.559673:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d3d06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.559693:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3d0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.559701:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3d0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.559708:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3d0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.561318:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3d14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.561345:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3d14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.561360:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3d14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790784478.561393:0:9249:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1790784478.561529:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d3d06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.561537:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d3d06 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.561545:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d3d06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.561550:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900031800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784478.561571:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d3d06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.561581:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d3d06 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.561596:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff945903af2300) 00010000:00010000:1.0:1790784478.561600:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784478.561606:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d3d06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.561613:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d3d06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.561634:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3d0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.561641:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3d0d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.561647:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3d0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.561652:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955f400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784478.561655:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3d0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.561662:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3d0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.561671:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94590345d100) 00010000:00010000:1.0:1790784478.561674:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784478.561683:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3d0d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.561689:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3d0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.561766:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d3cff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350df expref: 30 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.561784:0:9249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3d14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350df expref: 29 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.561792:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a200) 00010000:00010000:1.0:1790784478.561795:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790784478.561798:0:9249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94590955e000, rc 0) 00000100:00100000:1.0:1790784478.561894:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+29:10471:x1877773344880128:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 2422us (3312us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1790784478.561904:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 92 00000100:00100000:0.0:1790784478.566628:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784478.566872:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344880256 00000100:00100000:1.0:1790784478.566885:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344880256 00000100:00100000:1.0:1790784478.566959:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 93 00000100:00100000:1.0:1790784478.566979:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+29:10471:x1877773344880256:12345-192.168.206.32@tcp:54:lfs.0 00010000:00010000:1.0:1790784478.567415:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3d22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.567437:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d3cc7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350ca expref: 29 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.567448:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3d22 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.567505:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d3cc7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350ca expref: 29 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.567520:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d3cc7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350ca expref: 29 pid: 5819 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784478.567536:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593fe4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5820:1877773359579904:192.168.206.32@tcp:104: 00000100:00100000:1.0:1790784478.567661:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff94590ad12d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790784478.570942:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593fe4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5820:1877773359579904:192.168.206.32@tcp:104: 00010000:00010000:1.0:1790784478.570980:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3d22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784478.572316:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784478.572547:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344880512 00000100:00100000:2.0:1790784478.572559:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344880512 00000100:00100000:2.0:1790784478.573635:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 22 00000100:00100000:2.0:1790784478.573658:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+30:5590:x1877773344880512:12345-192.168.206.32@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790784478.574669:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+31:5590:x1877773344880512:12345-192.168.206.32@tcp:35:ldlm_bl.0 Request processed in 1013us (2356us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1790784478.574682:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 22 00000100:00100000:0.0:1790784478.578252:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784478.578473:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344880640 00000100:00100000:3.0:1790784478.578486:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344880640 00010000:00010000:3.0:1790784478.578535:0:8421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d3cc7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350ca expref: 31 pid: 5819 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784478.578626:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 48 00000100:00100000:3.0:1790784478.578638:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+31:2352:x1877773344880640:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790784478.578657:0:8421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784478.578666:0:8421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d3cc7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350ca expref: 31 pid: 5819 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.578681:0:8421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d3cc7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350ca expref: 31 pid: 5819 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.578740:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d3cc7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350ca expref: 31 pid: 5819 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.578829:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a200) 00010000:00010000:3.0:1790784478.578836:0:8421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3d22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.578848:0:8421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3d22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.578857:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3d22 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.578949:0:8421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790784478.579035:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+30:2352:x1877773344880640:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 398us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784478.579044:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 48 00010000:00010000:1.0:1790784478.579989:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3d22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.580004:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3d22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.580051:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3d22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.580059:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3d22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.580067:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3d22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.580074:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955f000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784478.580079:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3d22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.580117:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3d22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.580133:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a200) 00010000:00010000:1.0:1790784478.580137:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790784478.580143:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3d22 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.580149:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3d22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784478.580253:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+29:10471:x1877773344880256:12345-192.168.206.32@tcp:54:lfs.0 Request processed in 13272us (13634us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784478.580264:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 93 00000100:00100000:0.0:1790784478.583469:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784478.583711:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344880896 00000100:00100000:1.0:1790784478.583734:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344880896 00000100:00100000:1.0:1790784478.583909:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 23 00000100:00100000:1.0:1790784478.583921:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+29:10471:x1877773344880896:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:1.0:1790784478.584238:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+30:10471:x1877773344880896:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 318us (779us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1790784478.584246:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 23 00000100:00100000:0.0:1790784478.684879:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784478.685020:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344881152 00000100:00100000:2.0:1790784478.685034:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344881152 00000100:00100000:2.0:1790784478.685113:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 94 00000100:00100000:2.0:1790784478.685126:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+30:10483:x1877773344881152:12345-192.168.206.32@tcp:101:cat.0 00010000:00010000:2.0:1790784478.685160:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784478.685198:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3d29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381350e6 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784478.685296:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3d30 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784478.685313:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3d30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784478.685326:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3d30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784478.685361:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3d37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784478.685369:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3d37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784478.685431:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3d37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784478.686095:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d3d3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784478.686108:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d3d3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784478.686117:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d3d3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784478.686128:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1790784478.686286:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3d30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784478.686296:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3d30 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784478.686303:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3d30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784478.686309:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74200 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784478.686314:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3d30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784478.686336:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3d30 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784478.686351:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff945903af2300) 00010000:00010000:2.0:1790784478.686354:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784478.686361:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3d30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784478.686368:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3d30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784478.686411:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3d37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784478.686417:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3d37 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784478.686422:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3d37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784478.686428:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784478.686431:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3d37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784478.686437:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3d37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784478.686445:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff945903af2700) 00010000:00010000:2.0:1790784478.686448:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784478.686451:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3d37 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784478.686466:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3d37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784478.686520:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3d29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350e6 expref: 33 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784478.686536:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d3d3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350e6 expref: 32 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784478.686544:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a200) 00010000:00010000:2.0:1790784478.686547:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790784478.686550:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe75600, rc 0) 00000100:00100000:2.0:1790784478.686633:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+32:10483:x1877773344881152:12345-192.168.206.32@tcp:101:cat.0 Request processed in 1510us (1770us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1790784478.686642:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 94 00000100:00100000:0.0:1790784478.692593:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784478.694243:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344881408 00000100:00100000:2.0:1790784478.694263:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344881408 00000100:00100000:2.0:1790784478.694349:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 24 00000100:00100000:2.0:1790784478.694362:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+32:10483:x1877773344881408:12345-192.168.206.32@tcp:35:cat.0 00000100:00100000:2.0:1790784478.694703:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+33:10483:x1877773344881408:12345-192.168.206.32@tcp:35:cat.0 Request processed in 342us (2123us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1790784478.694712:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 24 00010000:00010000:3.0:1790784478.716702:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784478.729545:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784478.729837:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344881664 00000100:00100000:3.0:1790784478.729850:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344881664 00000100:00100000:3.0:1790784478.729973:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 95 00000100:00100000:3.0:1790784478.729986:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+33:10484:x1877773344881664:12345-192.168.206.32@tcp:36:rm.0 00010000:00010000:3.0:1790784478.730079:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790784478.730125:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d3d3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350e6 expref: 33 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.730156:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3d14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350df expref: 32 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.730200:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d3cdc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350d1 expref: 31 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.730212:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012a200) 00010000:00010000:3.0:1790784478.730227:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790784478.730264:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3d4c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.731161:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3d4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.731184:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3d4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.731209:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3d53 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.731220:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3d53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.731227:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3d53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.731710:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3d5a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.731733:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3d5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.731742:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3d5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790784478.737687:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1790784478.737712:0:5818:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 312887335898ns, next at 313887329797ns, rc = 0 00010000:00010000:3.0:1790784478.737850:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3d61 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.737871:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3d61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.737887:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3d61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.737898:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3d61 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.737906:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3d61 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.737912:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3d61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.737933:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790784478.737978:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3d5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.737985:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3d5a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.737992:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3d5a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.737998:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901524000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784478.738016:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3d5a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.738038:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3d5a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.738054:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012ad00) 00010000:00010000:3.0:1790784478.738057:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1790784478.738062:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3d5a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.738069:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3d5a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.738105:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3d4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.738112:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3d4c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.738117:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3d4c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.738122:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901525e00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784478.738125:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3d4c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.738131:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3d4c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.738138:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff945903af2300) 00010000:00010000:3.0:1790784478.738141:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784478.738150:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3d4c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.738155:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3d4c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790784478.738169:0:5818:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000079f2ffff reply state 0000000081b10414 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3d53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784478.738180:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790784478.738688:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790784478.738698:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3d61 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784478.738706:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901524800 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:0.0:1790784478.738709:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3d61 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784478.738716:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3d61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784478.738739:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94592012ad00) 00010000:00010000:0.0:1790784478.738742:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790784478.738745:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3d61 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784478.738751:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3d61 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784478.738770:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784478.738772:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784478.738774:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784478.738908:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+32:10484:x1877773344881664:12345-192.168.206.32@tcp:36:rm.0 Request processed in 8919us (9369us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1790784478.738919:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 95 00010000:00010000:3.0:1790784478.741183:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3d53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.741204:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3d53 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.741211:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3d53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.741217:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901525a00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784478.741222:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3d53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.741230:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3d53 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.741257:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94592012a800) 00010000:00010000:3.0:1790784478.741261:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784478.741267:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3d53 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.741297:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3d53 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784478.813531:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784478.813631:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344881920 00000100:00100000:1.0:1790784478.813645:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344881920 00000100:00100000:1.0:1790784478.813735:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 96 00000100:00100000:1.0:1790784478.813747:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+31:10490:x1877773344881920:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:1.0:1790784478.813787:0:9249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784478.813814:0:9249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3d68 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381350ed expref: -99 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.813984:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3d6f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.814001:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3d6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.814015:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3d6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.814208:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3d76 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.814217:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3d76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.814225:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3d76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790784478.815852:0:9249:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1790784478.816688:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3d7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.816710:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3d7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.816736:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3d7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.816786:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3d6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.816814:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3d6f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.816821:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3d6f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.816828:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955f400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784478.816833:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3d6f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.816841:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3d6f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.816855:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff945903af2300) 00010000:00010000:1.0:1790784478.816858:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784478.816877:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3d6f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.816885:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3d6f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790784478.816905:0:9249:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005cb23ef0 reply state 00000000e3aafb35 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3d76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784478.816915:0:9249:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790784478.816959:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3d68 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350ed expref: 34 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.816977:0:9249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3d7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350ed expref: 33 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.816999:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94590345df00) 00010000:00010000:1.0:1790784478.817002:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790784478.817004:0:9249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94590955f800, rc 0) 00000100:00100000:1.0:1790784478.817778:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+34:10490:x1877773344881920:12345-192.168.206.32@tcp:101:bash.0 Request processed in 4025us (4252us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1790784478.817789:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 96 00000100:00100000:0.0:1790784478.821943:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784478.822453:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344882048 00000100:00100000:3.0:1790784478.822467:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344882048 00000100:00100000:3.0:1790784478.822568:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 34 00000100:00100000:3.0:1790784478.822579:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2351:x1877773344882048:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:3.0:1790784478.822603:0:6669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784478.822630:0:6669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3d8b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381350f4 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790784478.822665:0:6669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790784478.822690:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=312s v=(0 0) 00010000:00010000:3.0:1790784478.822695:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784478.822706:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3d8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350f4 expref: 8 pid: 6669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.822738:0:6669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3d8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350f4 expref: 8 pid: 6669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.822755:0:6669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945901525a00, rc 0) 00000100:00100000:3.0:1790784478.822843:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:2351:x1877773344882048:12345-192.168.206.32@tcp:101:bash.0 Request processed in 266us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784478.822851:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 34 00000100:00080000:0.0:1790784478.824589:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790784478.826323:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784478.826509:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344882176 00000100:00100000:2.0:1790784478.826522:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344882176 00000100:00100000:2.0:1790784478.826596:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 35 00000100:00100000:2.0:1790784478.826608:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:10490:x1877773344882176:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:2.0:1790784478.826650:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784478.826683:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009408529d/0x2c3a1e2a079d3d92 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381350fb expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784478.826735:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3d8b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350f4 expref: 9 pid: 6669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784478.826745:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790784478.826751:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790784478.826766:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009408529d/0x2c3a1e2a079d3d92 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350fb expref: 9 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784478.826809:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3d8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350f4 expref: 9 pid: 6669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784478.826824:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3d8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350f4 expref: 9 pid: 6669 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784478.826840:0:6670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459102eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6670:1877773359580032:192.168.206.32@tcp:104: 00000100:00100000:2.0:1790784478.826954:0:6670:0:(client.c:2716:ptlrpc_set_wait()) set ffff945911e9c780 going to sleep for 11 seconds 00000100:00100000:0.0:1790784478.832756:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00010000:00010000:1.0:1790784478.833050:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3d76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.833065:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3d76 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.833074:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3d76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.833080:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955e800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784478.833348:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3d76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.833360:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3d76 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.833398:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94590345d100) 00010000:00010000:1.0:1790784478.833401:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784478.833407:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3d76 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784478.833414:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3d76 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784478.833612:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344882304 00000100:00100000:3.0:1790784478.833622:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344882304 00010000:00010000:3.0:1790784478.833673:0:8480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3d8b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350f4 expref: 10 pid: 6669 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784478.833716:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 49 00000100:00100000:3.0:1790784478.833736:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905196050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b0f9e8c2-ddb0-4027-babe-0b166585860c+10:2351:x1877773344882304:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790784478.833753:0:8480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784478.833785:0:8480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3d8b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350f4 expref: 10 pid: 6669 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.833800:0:8480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3d8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350f4 expref: 10 pid: 6669 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.833822:0:8480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784478.833826:0:8480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784478.833835:0:8480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009408529d/0x2c3a1e2a079d3d92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350fb expref: 10 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.833845:0:8480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009408529d/0x2c3a1e2a079d3d92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350fb expref: 10 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.833886:0:8480:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009408529d/0x2c3a1e2a079d3d92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350fb expref: 10 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784478.833901:0:8480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f495f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8480:1877773359580160:192.168.206.32@tcp:105: 00000100:00100000:3.0:1790784478.834004:0:8480:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459051ad000 going to sleep for 11 seconds 00010000:00010000:3.0:1790784478.834938:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3d8b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350f4 expref: 10 pid: 6669 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784478.835202:0:6670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459102eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6670:1877773359580032:192.168.206.32@tcp:104: 00010000:00010000:3.0:1790784478.835237:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009408529d/0x2c3a1e2a079d3d92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350fb expref: 9 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784478.835252:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74c00, rc 0) 00000100:00100000:3.0:1790784478.835573:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+9:10490:x1877773344882176:12345-192.168.206.32@tcp:101:bash.0 Request processed in 8966us (9261us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784478.835583:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 35 00000100:00100000:0.0:1790784478.849931:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784478.849975:0:8480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f495f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8480:1877773359580160:192.168.206.32@tcp:105: 00010000:00010000:3.0:1790784478.850007:0:8480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790784478.850913:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344882560 00000100:00100000:2.0:1790784478.850926:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344882560 00000100:00100000:2.0:1790784478.851011:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 25 00000100:00100000:2.0:1790784478.851023:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+33:10490:x1877773344882560:12345-192.168.206.32@tcp:35:bash.0 00000100:00100000:3.0:1790784478.857349:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905196050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:2351:x1877773344882304:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 23596us (24590us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784478.857368:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 49 00000100:00100000:2.0:1790784478.859175:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+34:10490:x1877773344882560:12345-192.168.206.32@tcp:35:bash.0 Request processed in 8136us (9240us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1790784478.859210:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 25 00000100:00100000:0.0:1790784479.053334:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784479.053490:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344882688 00000100:00100000:1.0:1790784479.053506:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344882688 00000100:00100000:1.0:1790784479.053590:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 97 00000100:00100000:1.0:1790784479.053614:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+34:10506:x1877773344882688:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:1.0:1790784479.053656:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784479.053698:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3d99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135102 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.053814:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3da0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.053834:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3da0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.053851:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3da0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790784479.053899:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1790784479.053903:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790784479.053926:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3da0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.053957:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3d99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135102 expref: 36 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.053986:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3da0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135102 expref: 35 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.053996:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff945903af2300) 00010000:00010000:1.0:1790784479.054016:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790784479.054022:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94590955f000, rc 0) 00000100:00100000:1.0:1790784479.054109:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+35:10506:x1877773344882688:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 507us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784479.054117:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 97 00000100:00100000:0.0:1790784479.065052:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784479.065142:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344882944 00000100:00100000:2.0:1790784479.065156:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344882944 00000100:00100000:2.0:1790784479.065240:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 98 00000100:00100000:2.0:1790784479.065252:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+35:10506:x1877773344882944:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:2.0:1790784479.065279:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784479.065305:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3da7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135109 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.065466:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3dae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.065484:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3dae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.065499:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3dae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784479.065512:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1790784479.065665:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3da7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135109 expref: 38 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.065687:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3dae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135109 expref: 37 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.065698:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94590345df00) 00010000:00010000:2.0:1790784479.065701:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790784479.065705:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74200, rc 0) 00000100:00100000:2.0:1790784479.065806:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+37:10506:x1877773344882944:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 556us (779us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1790784479.065814:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 98 00000100:00100000:0.0:1790784479.069153:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784479.069354:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344883200 00000100:00100000:1.0:1790784479.069368:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344883200 00000100:00100000:1.0:1790784479.069489:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 99 00000100:00100000:1.0:1790784479.069502:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+37:10506:x1877773344883200:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:1.0:1790784479.069537:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784479.069564:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3dbc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135110 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.069733:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3dc3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.069753:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3dc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.069767:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3dc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790784479.069786:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1790784479.069945:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3dbc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135110 expref: 40 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.069973:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3dc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135110 expref: 39 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.069995:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94590345df00) 00010000:00010000:1.0:1790784479.069999:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790784479.070004:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94590955f400, rc 0) 00000100:00100000:1.0:1790784479.070087:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+39:10506:x1877773344883200:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 587us (952us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1790784479.070095:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 99 00000100:00100000:0.0:1790784479.076361:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784479.077256:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344883328 00000100:00100000:1.0:1790784479.077271:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344883328 00000100:00100000:1.0:1790784479.077359:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 6 00000100:00100000:1.0:1790784479.077371:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+39:2352:x1877773344883328:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790784479.077411:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784479.077441:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3dae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135109 expref: 39 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.077465:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94590345df00) 00010000:00010000:1.0:1790784479.077470:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790784479.077546:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+38:2352:x1877773344883328:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 176us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784479.077553:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 6 00000100:00100000:0.0:1790784479.087759:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784479.087847:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344883456 00000100:00100000:3.0:1790784479.087860:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344883456 00000100:00100000:3.0:1790784479.087985:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 36 00000100:00100000:3.0:1790784479.087996:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:2350:x1877773344883456:12345-192.168.206.32@tcp:1:lfs.0 00010000:00010000:3.0:1790784479.088068:0:6669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3dd1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.088104:0:6669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009408529d/0x2c3a1e2a079d3d92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350fb expref: 8 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.088114:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1790784479.088137:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790784479.088143:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3dd1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.089394:0:6669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009408529d/0x2c3a1e2a079d3d92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350fb expref: 8 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.089426:0:6669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009408529d/0x2c3a1e2a079d3d92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350fb expref: 8 pid: 6670 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784479.089447:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f495500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6669:1877773359580288:192.168.206.32@tcp:104: 00000100:00100000:3.0:1790784479.089652:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459051ad600 going to sleep for 11 seconds 00000100:00100000:3.0:1790784479.100986:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f495500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6669:1877773359580288:192.168.206.32@tcp:104: 00010000:00010000:3.0:1790784479.101625:0:6669:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3dd1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784479.101908:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784479.102028:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344883584 00000100:00100000:2.0:1790784479.102452:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344883584 00002000:00100000:2.0:1790784479.102526:0:6675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff945907df4e00 x1877773344883584/t0(0) o4->b0f9e8c2-ddb0-4027-babe-0b166585860c@192.168.206.32@tcp:745/0 lens 504/0 e 0 to 0 dl 1790784490 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790784479.102538:0:6675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff945907df4e00 with x1877773344883584 ext(0->8) 00010000:00010000:2.0:1790784479.102548:0:6675:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009408529d/0x2c3a1e2a079d3d92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350fb expref: 9 pid: 6670 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.102566:0:6675:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009408529d/0x2c3a1e2a079d3d92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350fb expref: 9 pid: 6670 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790784479.102575:0:6675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff945907df4e00 00000100:00100000:2.0:1790784479.102617:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 1 00000100:00100000:2.0:1790784479.102629:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+9:2351:x1877773344883584:12345-192.168.206.32@tcp:4:lfs.0 00000100:00100000:2.0:1790784479.103664:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+11:2351:x1877773344883584:12345-192.168.206.32@tcp:4:lfs.0 Request processed in 1028us (1749us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1790784479.103676:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 1 00002000:00100000:2.0:1790784479.103688:0:6675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff945907df4e00 x1877773344883584/t4294967302(0) o4->b0f9e8c2-ddb0-4027-babe-0b166585860c@192.168.206.32@tcp:745/0 lens 504/448 e 0 to 0 dl 1790784490 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790784479.103699:0:6675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff945907df4e00 with x1877773344883584 ext(0->8) 00010000:00010000:2.0:1790784479.103708:0:6675:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009408529d/0x2c3a1e2a079d3d92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350fb expref: 11 pid: 6670 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.104600:0:6675:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009408529d/0x2c3a1e2a079d3d92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350fb expref: 11 pid: 6670 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790784479.104619:0:6675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff945907df4e00 00000100:00100000:0.0:1790784479.111521:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784479.111609:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344883712 00000100:00100000:3.0:1790784479.111621:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344883712 00010000:00010000:3.0:1790784479.111670:0:8421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009408529d/0x2c3a1e2a079d3d92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350fb expref: 11 pid: 6670 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784479.111725:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 50 00000100:00100000:3.0:1790784479.111736:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906868e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+11:2352:x1877773344883712:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790784479.111754:0:8421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1790784479.111788:0:8421:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1790784479.111792:0:8421:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790784478 00002000:00010000:3.0:1790784479.111811:0:8421:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790784478 00002000:00010000:3.0:1790784479.111814:0:8421:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1790784478 00010000:00010000:3.0:1790784479.111821:0:8421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009408529d/0x2c3a1e2a079d3d92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350fb expref: 11 pid: 6670 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.111837:0:8421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009408529d/0x2c3a1e2a079d3d92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350fb expref: 11 pid: 6670 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.111866:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009408529d/0x2c3a1e2a079d3d92 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350fb expref: 11 pid: 6670 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.111886:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790784479.111891:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790784479.111897:0:8421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3dd1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.111907:0:8421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3dd1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.111948:0:8421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790784479.112097:0:6669:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3dd1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784479.112107:0:6669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3dd1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784479.112134:0:6669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3dd1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784479.112142:0:6669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3dd1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784479.112150:0:6669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3dd1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784479.112156:0:6669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901525a00 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:0.0:1790784479.112161:0:6669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3dd1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784479.112171:0:6669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3dd1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784479.112197:0:6669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3dd1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784479.112204:0:6669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079e0e3f7/0x2c3a1e2a079d3dd1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784479.112479:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906868e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+10:2352:x1877773344883712:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 741us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784479.112490:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 50 00000100:00100000:0.0:1790784479.112576:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+9:2350:x1877773344883456:12345-192.168.206.32@tcp:1:lfs.0 Request processed in 24582us (24831us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784479.112584:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 36 00000100:00100000:0.0:1790784479.131236:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784479.133658:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344883968 00000100:00100000:1.0:1790784479.133679:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344883968 00000100:00100000:1.0:1790784479.133786:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 26 00000100:00100000:1.0:1790784479.133798:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc16850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+38:10506:x1877773344883968:12345-192.168.206.32@tcp:35:lfs.0 00000004:00010000:1.0:1790784479.133883:0:5822:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3dc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135110 expref: 38 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790784479.134259:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1790784479.134310:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1790784479.134731:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1790784479.134800:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3dd8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.134819:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3d7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350ed expref: 42 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.134830:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3dd8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.134875:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3d7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350ed expref: 42 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.134893:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3d7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350ed expref: 42 pid: 9249 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784479.134908:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593fe4e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5822:1877773359580416:192.168.206.32@tcp:104: 00000100:00100000:1.0:1790784479.135016:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910ff9000 going to sleep for 11 seconds 00000100:00100000:1.0:1790784479.144651:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784479.144780:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344884096 00000100:00100000:0.0:1790784479.144792:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344884096 00010000:00010000:0.0:1790784479.144848:0:8480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3d7d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350ed expref: 43 pid: 9249 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784479.144899:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 51 00000100:00100000:0.0:1790784479.144910:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b0f9e8c2-ddb0-4027-babe-0b166585860c+43:2351:x1877773344884096:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790784479.144928:0:8480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784479.144937:0:8480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3d7d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350ed expref: 43 pid: 9249 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784479.144955:0:8480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3d7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350ed expref: 43 pid: 9249 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784479.144983:0:8480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94590345df00) 00010000:00010000:0.0:1790784479.144997:0:8480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3dd8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784479.145009:0:8480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3dd8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784479.145018:0:8480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3dd8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784479.145044:0:8480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790784479.145126:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b0f9e8c2-ddb0-4027-babe-0b166585860c+43:2351:x1877773344884096:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 217us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784479.145134:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 51 00010000:00010000:3.0:1790784479.145156:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3d7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350ed expref: 42 pid: 9249 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784479.145177:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593fe4e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5822:1877773359580416:192.168.206.32@tcp:104: 00010000:00010000:3.0:1790784479.145209:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3dd8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.145219:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3dd8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.145225:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3dd8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790784479.145443:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1790784479.145683:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1790784479.145853:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f495500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5822:1877773359580544:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790784479.145924:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784479.145967:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459051ade40 going to sleep for 11 seconds 00000100:00100000:0.0:1790784479.147511:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359580544 00000100:00100000:0.0:1790784479.147530:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359580544 00000100:00100000:0.0:1790784479.147622:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790784479.147635:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5822:x1877773359580544:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790784479.147776:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5822:x1877773359580544:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 144us (1851us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784479.147784:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1790784479.147859:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790784479.148928:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f495500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5822:1877773359580544:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1790784479.149584:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1790784479.149687:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f495500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5822:1877773359580672:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790784479.149770:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784479.149800:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459051ad600 going to sleep for 11 seconds 00000100:00100000:0.0:1790784479.152090:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359580672 00000100:00100000:0.0:1790784479.152113:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359580672 00000100:00100000:0.0:1790784479.152197:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790784479.152210:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5822:x1877773359580672:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790784479.152902:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5822:x1877773359580672:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 691us (3128us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1790784479.152914:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790784479.154843:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f495500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5822:1877773359580672:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1790784479.154988:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1790784479.155077:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3dd8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.155099:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3dd8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.155124:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3dd8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.155131:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955e800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784479.155136:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3dd8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.155145:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3dd8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.155164:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94590345df00) 00010000:00010000:1.0:1790784479.155167:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1790784479.155172:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3dd8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.155179:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3dd8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790784479.155465:0:5822:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1790784479.155584:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1790784479.155596:0:5822:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 313305220052ns, next at 314305217858ns, rc = 0 00000001:00080000:1.0:1790784479.155603:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1790784479.155652:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94590345df00) 00010000:00010000:1.0:1790784479.155655:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790784479.155663:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3dc3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135110 expref: 46 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784479.155825:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc16850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+45:10506:x1877773344883968:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 22027us (24603us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1790784479.155848:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 26 00000020:00080000:1.0:1790784479.155856:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1790784479.158621:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784479.158714:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344884224 00000100:00100000:2.0:1790784479.158737:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344884224 00000100:00100000:2.0:1790784479.158806:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 100 00000100:00100000:2.0:1790784479.158818:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+45:10506:x1877773344884224:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:2.0:1790784479.158849:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784479.158877:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d3ddf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135117 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.158963:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d3ddf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135117 expref: 46 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.158982:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d3ddf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135117 expref: 46 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.159019:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff945903af2700) 00010000:00010000:2.0:1790784479.159023:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790784479.159027:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe75800, rc 0) 00000100:00100000:2.0:1790784479.159114:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+46:10506:x1877773344884224:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 298us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784479.159122:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 100 00000100:00100000:0.0:1790784479.169895:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784479.170345:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344884480 00000100:00100000:2.0:1790784479.170452:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344884480 00000100:00100000:2.0:1790784479.170581:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 27 00000100:00100000:2.0:1790784479.170593:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590686aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+46:10506:x1877773344884480:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:2.0:1790784479.170917:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590686aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+47:10506:x1877773344884480:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 325us (1036us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1790784479.170926:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 27 00000100:00100000:0.0:1790784479.264073:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784479.264571:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344884608 00000100:00100000:3.0:1790784479.264584:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344884608 00000100:00100000:3.0:1790784479.264658:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 101 00000100:00100000:3.0:1790784479.264670:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+47:10516:x1877773344884608:12345-192.168.206.32@tcp:34:lfs.0 00010000:00010000:3.0:1790784479.264775:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3de6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.264797:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3de6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.264826:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3de6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.264845:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3ded lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.264852:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3ded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.264860:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3ded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.264968:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3df4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.264978:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3df4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.264985:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3df4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790784479.265046:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3df4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.265061:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3de6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.265070:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3de6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.265078:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3de6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.265105:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901525e00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784479.265110:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3de6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.265120:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3de6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.265134:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff945903af2300) 00010000:00010000:3.0:1790784479.265137:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784479.265143:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3de6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.265150:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3de6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.265232:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3ded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.265241:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3ded lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.265247:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3ded lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.265253:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901524000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784479.265256:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3ded lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.265263:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3ded lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.265282:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94592012ad00) 00010000:00010000:3.0:1790784479.265285:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784479.265288:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3ded lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.265294:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3ded lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.265312:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3df4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.265319:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3df4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.265326:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3df4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.265331:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901525a00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784479.265335:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3df4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.265341:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3df4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.265348:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff945903af2700) 00010000:00010000:3.0:1790784479.265351:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784479.265354:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3df4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.265360:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3df4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784479.265539:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+47:10516:x1877773344884608:12345-192.168.206.32@tcp:34:lfs.0 Request processed in 869us (1476us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784479.265548:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 101 00000100:00100000:0.0:1790784479.305192:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784479.305411:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344884864 00000100:00100000:2.0:1790784479.305423:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344884864 00000100:00100000:2.0:1790784479.305495:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 102 00000100:00100000:2.0:1790784479.305507:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+47:10519:x1877773344884864:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:2.0:1790784479.305535:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784479.305560:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3dfb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813511e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.305657:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3e02 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.305674:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3e02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.305687:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3e02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.305703:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d3e09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.305710:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d3e09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.305727:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d3e09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.305893:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d3e10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.305903:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d3e10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.305910:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d3e10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784479.305921:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1790784479.306033:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3e02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.306042:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3e02 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.306050:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3e02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.306056:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75200 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784479.306061:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3e02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.306070:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3e02 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.306094:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff945903af2300) 00010000:00010000:2.0:1790784479.306098:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784479.306104:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3e02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.306122:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3e02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.306139:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d3e09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.306146:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d3e09 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.306151:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d3e09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.306157:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75e00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784479.306160:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d3e09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.306177:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d3e09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.306186:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff945903af2800) 00010000:00010000:2.0:1790784479.306189:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784479.306192:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d3e09 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.306198:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75e00/0x2c3a1e2a079d3e09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.306244:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d3dfb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813511e expref: 50 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.306261:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d3e10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813511e expref: 49 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784479.306275:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff945903af2700) 00010000:00010000:2.0:1790784479.306277:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790784479.306279:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74400, rc 0) 00000100:00100000:2.0:1790784479.306366:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+49:10519:x1877773344884864:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 861us (1200us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1790784479.307537:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 102 00000100:00100000:2.0:1790784479.310529:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784479.310907:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344884992 00000100:00100000:3.0:1790784479.310921:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344884992 00000100:00100000:3.0:1790784479.311046:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 103 00000100:00100000:3.0:1790784479.311058:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459102ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+49:10519:x1877773344884992:12345-192.168.206.32@tcp:54:lfs.0 00010000:00010000:3.0:1790784479.311159:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3e1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.311193:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3e1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.311207:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3e1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.311240:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3e1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.311248:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3e1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.311256:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3e1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.311262:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901525a00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784479.311267:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3e1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.311274:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3e1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.311308:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff945903af2700) 00010000:00010000:3.0:1790784479.311311:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790784479.311318:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3e1e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.311324:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3e1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784479.311472:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459102ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+49:10519:x1877773344884992:12345-192.168.206.32@tcp:54:lfs.0 Request processed in 415us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784479.311481:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 103 00000100:00100000:0.0:1790784479.314461:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784479.314593:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344885248 00000100:00100000:1.0:1790784479.314605:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344885248 00000100:00100000:1.0:1790784479.314673:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 28 00000100:00100000:1.0:1790784479.314684:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+49:10519:x1877773344885248:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:1.0:1790784479.315126:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+50:10519:x1877773344885248:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 441us (675us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1790784479.315135:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 28 00000100:00100000:0.0:1790784479.386883:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784479.387001:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344885504 00000100:00100000:1.0:1790784479.387015:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344885504 00000100:00100000:1.0:1790784479.387105:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 104 00000100:00100000:1.0:1790784479.387117:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+50:10529:x1877773344885504:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:1.0:1790784479.387150:0:9249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784479.387154:0:9249:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790784479.387198:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3da0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135102 expref: 50 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.387223:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff945903af2300) 00010000:00010000:1.0:1790784479.387229:0:9249:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790784479.387254:0:9249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3e25 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135125 expref: -99 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.387369:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e2c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.387467:0:9249:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d3e10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813511e expref: 50 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.387477:0:9249:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e2c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.387518:0:9249:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d3e10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813511e expref: 50 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.387533:0:9249:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d3e10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813511e expref: 50 pid: 5819 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784479.387549:0:9249:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459056d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9249:1877773359580800:192.168.206.32@tcp:104: 00000100:00100000:1.0:1790784479.387671:0:9249:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910ff9000 going to sleep for 11 seconds 00000100:00100000:0.0:1790784479.391519:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784479.391602:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344885632 00000100:00100000:3.0:1790784479.391613:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344885632 00010000:00010000:3.0:1790784479.391667:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d3e10 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813511e expref: 51 pid: 5819 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784479.391726:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 52 00000100:00100000:3.0:1790784479.391738:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f491880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+51:2351:x1877773344885632:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790784479.391769:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784479.391778:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d3e10 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813511e expref: 51 pid: 5819 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.391793:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d3e10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813511e expref: 51 pid: 5819 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.391821:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff945903af2700) 00010000:00010000:3.0:1790784479.391827:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e2c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.391856:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e2c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.391866:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e2c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.391890:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790784479.391967:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f491880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+51:2351:x1877773344885632:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 231us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784479.391976:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 52 00010000:00010000:1.0:1790784479.393196:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d3e10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813511e expref: 50 pid: 5819 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784479.393225:0:9249:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459056d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9249:1877773359580800:192.168.206.32@tcp:104: 00010000:00010000:1.0:1790784479.393253:0:9249:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e2c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.393264:0:9249:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e2c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.393269:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e2c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790784479.393294:0:9249:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1790784479.393522:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3e25 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135125 expref: 51 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.393542:0:9249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e2c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135125 expref: 50 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.393551:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff945903af2700) 00010000:00010000:1.0:1790784479.393554:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790784479.393558:0:9249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94590955e800, rc 0) 00000100:00100000:1.0:1790784479.393623:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+50:10529:x1877773344885504:12345-192.168.206.32@tcp:101:bash.0 Request processed in 6509us (6753us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1790784479.393632:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 104 00000100:00100000:0.0:1790784479.398668:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784479.398896:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344885888 00000100:00100000:1.0:1790784479.398911:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344885888 00000100:00100000:0.0:1790784479.399307:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 105 00000100:00100000:0.0:1790784479.399321:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+50:10529:x1877773344885888:12345-192.168.206.32@tcp:36:bash.0 00010000:00010000:0.0:1790784479.399828:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3e3a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784479.399852:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3e3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784479.399866:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3e3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790784479.399927:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1790784479.400021:0:5820:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000001278bc reply state 00000000e0eded57 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3e3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784479.400037:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790784479.400574:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+53:10529:x1877773344885888:12345-192.168.206.32@tcp:36:bash.0 Request processed in 1251us (1913us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1790784479.400584:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 105 00000020:00080000:0.0:1790784479.400591:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790784479.404462:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784479.404585:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344886016 00000100:00100000:1.0:1790784479.404597:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344886016 00000100:00100000:1.0:1790784479.404667:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 106 00000100:00100000:1.0:1790784479.404678:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+53:10529:x1877773344886016:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:1.0:1790784479.404708:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784479.404759:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3e41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813512c expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.404860:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3e48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.404876:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e2c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135125 expref: 54 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.404885:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3e3a lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.404910:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3e48 lrc: 5/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.404929:0:5819:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3e3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.404969:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e2c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135125 expref: 54 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.404983:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e2c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135125 expref: 54 pid: 9249 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784479.404998:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459056d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5819:1877773359580928:192.168.206.32@tcp:104: 00000100:00100000:1.0:1790784479.405774:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592d01d600 going to sleep for 11 seconds 00010000:00010000:3.0:1790784479.407454:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3e3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.407474:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3e3a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.407483:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3e3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.407490:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b0200 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784479.407497:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3e3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.407505:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3e3a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.407524:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff945903af2700) 00010000:00010000:3.0:1790784479.407528:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784479.407532:0:3266:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3e48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.407564:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3e3a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.407572:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3e3a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784479.407877:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459056d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5819:1877773359580928:192.168.206.32@tcp:104: 00010000:00010000:1.0:1790784479.407903:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3e48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784479.409725:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784479.409970:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344886144 00000100:00100000:3.0:1790784479.409982:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344886144 00010000:00010000:3.0:1790784479.410030:0:8421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e2c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135125 expref: 54 pid: 9249 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784479.410074:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 53 00000100:00100000:3.0:1790784479.410095:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f490a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+54:2350:x1877773344886144:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790784479.410113:0:8421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784479.410120:0:8421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e2c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135125 expref: 54 pid: 9249 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.410135:0:8421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e2c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135125 expref: 54 pid: 9249 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.410160:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e2c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135125 expref: 54 pid: 9249 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.410191:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff945903af2700) 00010000:00010000:3.0:1790784479.410197:0:8421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3e48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.410209:0:8421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3e48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.410234:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3e48 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.410267:0:8421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790784479.410342:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f490a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+53:2350:x1877773344886144:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 258us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784479.410350:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 53 00010000:00010000:1.0:1790784479.410511:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3e48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.410520:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3e48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790784479.410578:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1790784479.410583:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790784479.410606:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3e48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.410652:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3e41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813512c expref: 53 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.410670:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3e48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813512c expref: 52 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.410678:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff945903af2700) 00010000:00010000:1.0:1790784479.410681:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790784479.410684:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94590955e000, rc 0) 00000100:00100000:1.0:1790784479.410713:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+52:10529:x1877773344886016:12345-192.168.206.32@tcp:101:bash.0 Request processed in 6037us (6264us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784479.410733:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 106 00000100:00100000:2.0:1790784479.414342:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784479.414563:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344886400 00000100:00100000:3.0:1790784479.414575:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344886400 00000100:00100000:3.0:1790784479.414644:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 29 00000100:00100000:3.0:1790784479.414656:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459102e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+52:10529:x1877773344886400:12345-192.168.206.32@tcp:35:bash.0 00000100:00100000:3.0:1790784479.414974:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459102e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+53:10529:x1877773344886400:12345-192.168.206.32@tcp:35:bash.0 Request processed in 318us (644us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1790784479.414983:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 29 00000100:00100000:2.0:1790784479.485814:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784479.485945:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344886528 00000100:00100000:3.0:1790784479.486482:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344886528 00000100:00100000:3.0:1790784479.486611:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 107 00000100:00100000:3.0:1790784479.486623:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459102eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+53:10535:x1877773344886528:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:3.0:1790784479.486655:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784479.486681:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3e4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135133 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.486802:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3e56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.486819:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3e56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.486843:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3e56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790784479.486885:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1790784479.486890:0:5818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790784479.486908:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3e56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.486948:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3e4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135133 expref: 55 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.486973:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3e56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135133 expref: 54 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784479.486982:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff945903af2300) 00010000:00010000:3.0:1790784479.486984:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790784479.486989:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945901524000, rc 0) 00000100:00100000:3.0:1790784479.487088:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459102eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+54:10535:x1877773344886528:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 460us (1280us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784479.487097:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 107 00000100:00100000:0.0:1790784479.499313:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784479.499476:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344886656 00000100:00100000:1.0:1790784479.499492:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344886656 00000100:00100000:1.0:1790784479.499584:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 108 00000100:00100000:1.0:1790784479.499596:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+54:10535:x1877773344886656:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:1.0:1790784479.499622:0:9249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784479.499648:0:9249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3e5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813513a expref: -99 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.499750:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3e64 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.499767:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3e64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.499780:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3e64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.499816:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.499824:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.499831:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.499951:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3e72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.499961:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3e72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.499968:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3e72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790784479.500012:0:9249:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1790784479.500017:0:9249:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790784479.500040:0:9249:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3e72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.500054:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3e72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.500063:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3e64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.500070:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3e64 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.500103:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3e64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.500110:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955f400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784479.500116:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3e64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.500125:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3e64 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.500139:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff945903af2300) 00010000:00010000:1.0:1790784479.500142:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784479.500149:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3e64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.500155:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3e64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.500183:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.500190:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e6b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.500196:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.500202:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955e800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784479.500205:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.500222:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.500233:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94590345df00) 00010000:00010000:1.0:1790784479.500234:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784479.500238:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e6b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.500243:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.500286:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3e5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813513a expref: 56 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.500300:0:9249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3e72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813513a expref: 55 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.500306:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff945903af2700) 00010000:00010000:1.0:1790784479.500308:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790784479.500311:0:9249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94590955f800, rc 0) 00000100:00100000:1.0:1790784479.500429:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+55:10535:x1877773344886656:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 835us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784479.500437:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 108 00000100:00100000:2.0:1790784479.504999:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784479.505057:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784479.505212:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344886912 00000100:00100000:0.0:1790784479.505224:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344886912 00000100:00100000:0.0:1790784479.505321:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 109 00000100:00100000:0.0:1790784479.505333:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459102e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+55:10535:x1877773344886912:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:0.0:1790784479.505361:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784479.505428:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d3e79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135141 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784479.505558:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3e80 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784479.505575:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3e48 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813512c expref: 56 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784479.505584:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3e72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813513a expref: 56 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784479.505593:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3e80 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784479.505638:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3e72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813513a expref: 56 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784479.505654:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3e72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813513a expref: 56 pid: 9249 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784479.505668:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f493800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5820:1877773359581056:192.168.206.32@tcp:104: 00010000:00010000:0.0:1790784479.505795:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3e48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813512c expref: 56 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784479.505818:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3e48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813512c expref: 56 pid: 5819 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784479.505828:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f492d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5820:1877773359581184:192.168.206.32@tcp:104: 00000100:00100000:0.0:1790784479.505856:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593fe4af00 going to sleep for 11 seconds 00000100:00100000:1.0:1790784479.506008:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344887040 00000100:00100000:1.0:1790784479.506014:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344887040 00010000:00010000:1.0:1790784479.506052:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3e72 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813513a expref: 57 pid: 9249 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784479.506109:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 54 00000100:00100000:1.0:1790784479.506119:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459102e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+57:2351:x1877773344887040:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790784479.506130:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784479.506137:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3e72 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813513a expref: 57 pid: 9249 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.506149:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3e72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813513a expref: 57 pid: 9249 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.506171:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff945903af2700) 00010000:00010000:1.0:1790784479.506177:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3e80 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.506184:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3e80 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.506191:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790784479.506219:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459102e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+57:2351:x1877773344887040:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 102us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784479.506227:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 54 00010000:00010000:0.0:1790784479.510259:0:5820:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.32@tcp) returned -22 from blocking AST (req@0000000068d3de08 x1877773359581056) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3e72 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813513a expref: 56 pid: 9249 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784479.510290:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3e72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813513a expref: 56 pid: 9249 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784479.510315:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f493800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5820:1877773359581056:192.168.206.32@tcp:104: 00000100:00100000:0.0:1790784479.510333:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f492d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5820:1877773359581184:192.168.206.32@tcp:104: 00010000:00010000:0.0:1790784479.510363:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff945903af2700) 00010000:00010000:0.0:1790784479.510369:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3e80 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784479.510443:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3e80 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784479.510454:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3e80 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784479.511156:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784479.512013:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344887168 00000100:00100000:0.0:1790784479.512028:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344887168 00010000:00010000:0.0:1790784479.512816:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3e48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813512c expref: 56 pid: 5819 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784479.512883:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 55 00000100:00100000:0.0:1790784479.512899:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905196c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+56:2352:x1877773344887168:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790784479.512916:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784479.512923:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3e48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813512c expref: 56 pid: 5819 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784479.512936:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3e48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813512c expref: 56 pid: 5819 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784479.512971:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3e48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813512c expref: 56 pid: 5819 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784479.512996:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff945903af2700) 00010000:00010000:0.0:1790784479.513001:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3e80 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784479.513011:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3e80 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784479.513020:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3e80 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784479.513131:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790784479.513219:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905196c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+55:2352:x1877773344887168:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 326us (2081us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784479.513228:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 55 00010000:00010000:1.0:1790784479.517623:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3e80 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.517642:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3e80 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790784479.517671:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1790784479.517910:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d3e79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135141 expref: 56 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.517933:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3e80 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135141 expref: 55 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.517943:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff945903af2700) 00010000:00010000:1.0:1790784479.517947:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790784479.517963:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b0200, rc 0) 00000100:00100000:1.0:1790784479.518057:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459102e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+55:10535:x1877773344886912:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 12726us (13071us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1790784479.518067:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 109 00000100:00100000:3.0:1790784479.527840:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784479.527944:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344887424 00000100:00100000:0.0:1790784479.527966:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344887424 00000100:00100000:0.0:1790784479.528044:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 7 00000100:00100000:0.0:1790784479.528056:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fe4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b0f9e8c2-ddb0-4027-babe-0b166585860c+55:10535:x1877773344887424:12345-192.168.206.32@tcp:103:lfs.0 00010000:00010000:0.0:1790784479.528075:0:8480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784479.528117:0:8480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d3ddf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135117 expref: 55 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784479.528143:0:8480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff945903af2700) 00010000:00010000:0.0:1790784479.528149:0:8480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790784479.528225:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fe4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b0f9e8c2-ddb0-4027-babe-0b166585860c+54:10535:x1877773344887424:12345-192.168.206.32@tcp:103:lfs.0 Request processed in 170us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784479.528234:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 7 00000100:00100000:0.0:1790784479.530908:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784479.531000:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344887552 00000100:00100000:1.0:1790784479.531012:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344887552 00000100:00100000:1.0:1790784479.531091:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 110 00000100:00100000:1.0:1790784479.531102:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+54:10535:x1877773344887552:12345-192.168.206.32@tcp:58:lfs.0 00010000:00010000:1.0:1790784479.531256:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3e8e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.531276:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3e8e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.531290:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3e8e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790784479.531565:0:9249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1790784479.531663:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+54:10535:x1877773344887552:12345-192.168.206.32@tcp:58:lfs.0 Request processed in 560us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784479.531672:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 110 00000100:00100000:3.0:1790784479.537052:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784479.537191:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344887680 00000100:00100000:1.0:1790784479.537205:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344887680 00000100:00100000:1.0:1790784479.537277:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 111 00000100:00100000:1.0:1790784479.537288:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906bea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+54:10535:x1877773344887680:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:1.0:1790784479.537314:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784479.537340:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135148 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.537448:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3e8e lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.537460:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e95 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135148 expref: 55 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.537484:0:5818:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3e8e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.537499:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e95 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135148 expref: 55 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.537514:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff945903af2700) 00010000:00010000:1.0:1790784479.537517:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790784479.537521:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e95 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135148 expref: 55 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784479.537531:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94590955e800, rc 0) 00000100:00100000:1.0:1790784479.540624:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906bea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+55:10535:x1877773344887680:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 3312us (3560us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784479.540639:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 111 00010000:00010000:3.0:1790784479.739533:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790784479.759759:0:6693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1790784479.759801:0:6693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:2.0:1790784479.759821:0:6693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000040:00080000:2.0:1790784479.994797:0:11656:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790784479.994811:0:11656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790784479.994883:0:11656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1790784479.994890:0:11656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790784479.995566:0:11656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459102e9c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11656:1877773359581312:192.168.206.32@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790784479.995778:0:11656:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459056c9780 going to sleep for 11 seconds 00000100:00100000:3.0:1790784480.004841:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784480.005060:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344887808 00000100:00100000:1.0:1790784480.005072:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344887808 00000100:00100000:1.0:1790784480.005164:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 112 00000100:00100000:1.0:1790784480.005176:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f50e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+56:10536:x1877773344887808:12345-192.168.206.32@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790784480.005217:0:9249:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790784480.005348:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f50e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+56:10536:x1877773344887808:12345-192.168.206.32@tcp:53:lhsmtool_posix.0 Request processed in 174us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784480.005356:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 112 00000100:00080000:3.0:1790784480.008905:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790784480.011448:0:11656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459102e9c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11656:1877773359581312:192.168.206.32@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790784480.013042:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784480.014551:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344887936 00000100:00100000:0.0:1790784480.014569:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344887936 00000100:00100000:0.0:1790784480.014652:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 113 00000100:00100000:0.0:1790784480.014664:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945934a14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+55:10536:x1877773344887936:12345-192.168.206.32@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1790784480.014778:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d3e9c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.014799:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d3e9c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.014816:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d3e9c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.014854:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3ea3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.014862:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.014869:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.014899:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d3eaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.014909:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d3eaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.014916:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d3eaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790784480.014977:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1790784480.014982:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790784480.015001:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d3eaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.015012:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d3e9c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.015028:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d3e9c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.015043:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d3e9c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.015059:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b0c00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784480.015065:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d3e9c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.015074:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d3e9c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.015207:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94592012a400) 00010000:00010000:0.0:1790784480.015211:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784480.015218:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d3e9c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.015225:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d3e9c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.015313:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.015322:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3ea3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.015328:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.015334:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b0400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784480.015337:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.015344:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3ea3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.015363:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff945903a23a00) 00010000:00010000:0.0:1790784480.015365:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784480.015369:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3ea3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.015550:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3ea3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.015567:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d3eaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.015572:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d3eaa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.015577:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d3eaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.015582:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b1000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784480.015584:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d3eaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.015590:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d3eaa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.015597:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff945903af2700) 00010000:00010000:0.0:1790784480.015600:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784480.015603:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d3eaa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.015607:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d3eaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784480.015756:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945934a14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+55:10536:x1877773344887936:12345-192.168.206.32@tcp:34:lhsmtool_posix.0 Request processed in 1091us (2737us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784480.015765:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 113 00000100:00100000:3.0:1790784480.022927:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784480.023105:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344888192 00000100:00100000:1.0:1790784480.023119:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344888192 00000100:00100000:1.0:1790784480.023193:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 114 00000100:00100000:1.0:1790784480.023206:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945934a16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+55:10536:x1877773344888192:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790784480.023232:0:9249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784480.023268:0:9249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3eb1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813514f expref: -99 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.023438:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3eb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.023456:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.023469:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790784480.023482:0:9249:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1790784480.023603:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.023632:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3eb8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.023640:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3eb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.023646:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955e000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784480.023652:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3eb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.023661:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3eb8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.023676:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff945903af2700) 00010000:00010000:1.0:1790784480.023679:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790784480.023686:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3eb8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.023693:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3eb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.023765:0:9249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3eb1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813514f expref: 57 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.023778:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94592012a400) 00010000:00010000:1.0:1790784480.023780:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790784480.023784:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3eb1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813514f expref: 57 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.023795:0:9249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94590955f400, rc 0) 00000100:00100000:1.0:1790784480.023867:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945934a16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+56:10536:x1877773344888192:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 663us (953us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1790784480.023876:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 114 00000100:00100000:0.0:1790784480.033179:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784480.033270:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344888320 00000100:00100000:1.0:1790784480.033283:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344888320 00000100:00100000:1.0:1790784480.033360:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 115 00000100:00100000:1.0:1790784480.033372:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+56:10536:x1877773344888320:12345-192.168.206.32@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790784480.033446:0:5820:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790784480.033582:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+56:10536:x1877773344888320:12345-192.168.206.32@tcp:53:lhsmtool_posix.0 Request processed in 211us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784480.033591:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 115 00000100:00100000:3.0:1790784480.038600:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784480.040357:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344888576 00000100:00100000:1.0:1790784480.040430:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344888576 00000100:00100000:1.0:1790784480.040572:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 116 00000100:00100000:1.0:1790784480.040585:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945934a14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+56:10536:x1877773344888576:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790784480.040613:0:9249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784480.040617:0:9249:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790784480.040651:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3e56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135133 expref: 56 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.040678:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff945903af2300) 00010000:00010000:1.0:1790784480.040685:0:9249:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790784480.040702:0:9249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3ec6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135156 expref: -99 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790784480.041737:0:9249:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1790784480.041983:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3ecd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.042009:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3ecd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.042024:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3ecd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.043236:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3ec6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135156 expref: 58 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.043404:0:9249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3ecd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135156 expref: 57 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.043413:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94590345d100) 00010000:00010000:1.0:1790784480.043416:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790784480.043420:0:9249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94590955e000, rc 0) 00000100:00100000:1.0:1790784480.043514:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945934a14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+57:10536:x1877773344888576:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 2931us (4927us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1790784480.043525:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 116 00000100:00100000:2.0:1790784480.052022:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784480.053642:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344888832 00000100:00100000:0.0:1790784480.053662:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344888832 00000100:00100000:0.0:1790784480.053761:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 117 00000100:00100000:0.0:1790784480.053775:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459102e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+57:10536:x1877773344888832:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790784480.053851:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784480.053883:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3ecd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135156 expref: 57 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.053912:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94590345d100) 00010000:00010000:0.0:1790784480.053925:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790784480.053965:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d3edb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.053981:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d3edb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.053991:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d3edb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.054206:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3ee2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xe21990df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.054229:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe21990df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.054260:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe21990df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.054330:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d3edb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.054338:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d3edb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.054345:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d3edb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.054351:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b1000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784480.054355:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d3edb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.054363:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d3edb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.054411:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff945903af2300) 00010000:00010000:0.0:1790784480.054414:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784480.054419:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d3edb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.054426:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d3edb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.054440:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe21990df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.054447:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3ee2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe21990df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.054459:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3ee2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe21990df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.054464:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b0400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784480.054467:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3ee2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe21990df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.054475:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3ee2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe21990df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.054485:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xe21990df (ffff945903a23a00) 00010000:00010000:0.0:1790784480.054488:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784480.054492:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3ee2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe21990df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.054499:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d3ee2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe21990df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784480.055623:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459102e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+56:10536:x1877773344888832:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 Request processed in 1846us (3619us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790784480.055633:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 117 00000100:00100000:2.0:1790784480.062011:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784480.062193:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344888960 00000100:00100000:3.0:1790784480.062208:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344888960 00000100:00100000:3.0:1790784480.062315:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 118 00000100:00100000:3.0:1790784480.062328:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459102e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+56:10536:x1877773344888960:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790784480.062354:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784480.062406:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3ee9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813515d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.062453:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3ef0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.062471:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.062486:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.062620:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3ee9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813515d expref: 58 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.062645:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813515d expref: 57 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.062654:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94592012a600) 00010000:00010000:3.0:1790784480.062658:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790784480.062662:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945901525e00, rc 0) 00000100:00100000:3.0:1790784480.062767:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459102e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+57:10536:x1877773344888960:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 442us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784480.062774:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 118 00000100:00100000:2.0:1790784480.072119:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784480.072249:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344889216 00000100:00100000:1.0:1790784480.072265:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344889216 00000100:00100000:1.0:1790784480.072341:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 119 00000100:00100000:1.0:1790784480.072355:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459102e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+57:10536:x1877773344889216:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790784480.072509:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3ef7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.072530:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.072567:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790784480.072925:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:1.0:1790784480.072937:0:5820:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 314222561192ns, next at 315222558567ns, rc = 0 00000004:00010000:1.0:1790784480.073054:0:5820:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067c71008 reply state 000000006a1fe59f transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784480.073064:0:5820:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790784480.073737:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459102e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+59:10536:x1877773344889216:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 Request processed in 1381us (1629us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1790784480.073765:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 119 00000100:00100000:2.0:1790784480.077242:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00010000:00010000:1.0:1790784480.077413:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.077429:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3ef7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.077438:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3ef7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.077445:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955f800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784480.077450:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3ef7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.077459:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3ef7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.077477:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94592012a600) 00010000:00010000:1.0:1790784480.077481:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790784480.077487:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3ef7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.077493:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d3ef7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784480.078108:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344889344 00000100:00100000:3.0:1790784480.078123:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344889344 00000100:00100000:3.0:1790784480.078203:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 120 00000100:00100000:3.0:1790784480.078216:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459102eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+58:10536:x1877773344889344:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790784480.078247:0:9249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784480.078267:0:9249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3efe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135164 expref: -99 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.078341:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3efe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135164 expref: 59 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.078357:0:9249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3efe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135164 expref: 59 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.078408:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94592012a600) 00010000:00010000:3.0:1790784480.078411:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790784480.078414:0:9249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945901524800, rc 0) 00000100:00100000:3.0:1790784480.078484:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459102eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+59:10536:x1877773344889344:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 270us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784480.078490:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 120 00000100:00100000:3.0:1790784480.088581:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784480.088757:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344889472 00000100:00100000:2.0:1790784480.088769:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344889472 00000100:00100000:2.0:1790784480.088858:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 37 00000100:00100000:2.0:1790784480.088870:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945934a17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:2352:x1877773344889472:12345-192.168.206.32@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1790784480.089406:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945934a17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+9:2352:x1877773344889472:12345-192.168.206.32@tcp:2:lhsmtool_posix.0 Request processed in 501us (803us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1790784480.089416:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 37 00000100:00080000:3.0:1790784480.090455:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790784480.092464:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784480.094263:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344889728 00000100:00100000:3.0:1790784480.094284:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344889728 00000100:00100000:3.0:1790784480.094364:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 30 00000100:00100000:3.0:1790784480.094391:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+59:10536:x1877773344889728:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790784480.094681:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+60:10536:x1877773344889728:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 Request processed in 307us (2228us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1790784480.094707:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 30 00000100:00100000:1.0:1790784480.103350:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784480.103697:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344889984 00000100:00100000:0.0:1790784480.103756:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344889984 00000100:00100000:0.0:1790784480.103822:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 121 00000100:00100000:0.0:1790784480.103834:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+60:10536:x1877773344889984:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790784480.103975:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+60:10536:x1877773344889984:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 Request processed in 143us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784480.103983:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 121 00000100:00100000:2.0:1790784480.107776:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784480.107927:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344890112 00000100:00100000:3.0:1790784480.107939:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344890112 00000100:00100000:3.0:1790784480.108020:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 122 00000100:00100000:3.0:1790784480.108031:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592dac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+60:10536:x1877773344890112:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790784480.108057:0:9249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784480.108094:0:9249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3f05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813516b expref: -99 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.108183:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3f0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.108200:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3f0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.108213:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3f0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790784480.108262:0:9249:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790784480.108285:0:9249:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3f0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.108319:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3f05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813516b expref: 62 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.108343:0:9249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3f0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813516b expref: 61 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.108353:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94592012a600) 00010000:00010000:3.0:1790784480.108370:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790784480.108648:0:9249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945901524600, rc 0) 00000100:00100000:3.0:1790784480.108742:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592dac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+61:10536:x1877773344890112:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 711us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784480.108758:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 122 00000100:00100000:3.0:1790784480.114978:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784480.115158:0:8181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344890240 00000100:00100000:2.0:1790784480.115172:0:8181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344890240 00000100:00100000:2.0:1790784480.115247:0:8181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 38 00000100:00100000:2.0:1790784480.115260:0:8181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945934a14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+9:2351:x1877773344890240:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790784480.115283:0:8181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784480.115310:0:8181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036399935/0x2c3a1e2a079d3f13 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135172 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790784480.115344:0:8181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abd33df, blocks: 0x1 00010000:00010000:2.0:1790784480.115369:0:8181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=314s v=(0 0) 00010000:00010000:2.0:1790784480.115412:0:8181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790784480.115423:0:8181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036399935/0x2c3a1e2a079d3f13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135172 expref: 10 pid: 8181 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784480.115446:0:8181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000036399935/0x2c3a1e2a079d3f13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135172 expref: 10 pid: 8181 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784480.115480:0:8181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74200, rc 0) 00000100:00100000:2.0:1790784480.115549:0:8181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945934a14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+10:2351:x1877773344890240:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 292us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784480.115557:0:8181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 38 00000100:00100000:2.0:1790784480.127246:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784480.127428:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344890496 00000100:00100000:1.0:1790784480.127441:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344890496 00000100:00100000:1.0:1790784480.127514:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 123 00000100:00100000:1.0:1790784480.127528:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592dac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+61:10536:x1877773344890496:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790784480.127664:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592dac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+61:10536:x1877773344890496:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 Request processed in 141us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784480.127672:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 123 00000100:00100000:3.0:1790784480.131916:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784480.132509:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344890624 00000100:00100000:1.0:1790784480.132525:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344890624 00000100:00100000:1.0:1790784480.132600:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 39 00000100:00100000:1.0:1790784480.132612:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945934a15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+10:10536:x1877773344890624:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790784480.132636:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784480.132659:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089e04fac/0x2c3a1e2a079d3f1a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135179 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.132700:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000036399935/0x2c3a1e2a079d3f13 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135172 expref: 11 pid: 8181 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.132719:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784480.132725:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784480.132732:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089e04fac/0x2c3a1e2a079d3f1a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135179 expref: 11 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.132804:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000036399935/0x2c3a1e2a079d3f13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135172 expref: 11 pid: 8181 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.132819:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000036399935/0x2c3a1e2a079d3f13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135172 expref: 11 pid: 8181 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784480.132834:0:6670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459056dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6670:1877773359581440:192.168.206.32@tcp:104: 00000100:00100000:1.0:1790784480.135345:0:6670:0:(client.c:2716:ptlrpc_set_wait()) set ffff945911e9cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790784480.137238:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784480.137336:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344890752 00000100:00100000:2.0:1790784480.137349:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344890752 00010000:00010000:2.0:1790784480.137454:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000036399935/0x2c3a1e2a079d3f13 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135172 expref: 12 pid: 8181 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784480.137495:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 56 00000100:00100000:2.0:1790784480.137507:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945934a17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+12:2351:x1877773344890752:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790784480.137525:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784480.137555:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000036399935/0x2c3a1e2a079d3f13 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135172 expref: 12 pid: 8181 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784480.137571:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000036399935/0x2c3a1e2a079d3f13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135172 expref: 12 pid: 8181 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784480.137601:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790784480.137606:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790784480.137616:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000089e04fac/0x2c3a1e2a079d3f1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135179 expref: 12 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784480.137655:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089e04fac/0x2c3a1e2a079d3f1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135179 expref: 12 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784480.137724:0:5803:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000089e04fac/0x2c3a1e2a079d3f1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135179 expref: 12 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784480.137740:0:5803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592dac8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5803:1877773359581568:192.168.206.32@tcp:105: 00010000:00010000:1.0:1790784480.138168:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036399935/0x2c3a1e2a079d3f13 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135172 expref: 12 pid: 8181 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784480.138188:0:6670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459056dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6670:1877773359581440:192.168.206.32@tcp:104: 00010000:00010000:1.0:1790784480.138217:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000089e04fac/0x2c3a1e2a079d3f1a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135179 expref: 11 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.138229:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94590955f800, rc 0) 00000100:00100000:1.0:1790784480.138274:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945934a15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+11:10536:x1877773344890624:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 5665us (6372us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784480.138283:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 39 00000100:00100000:2.0:1790784480.147319:0:5803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459056c9780 going to sleep for 11 seconds 00000100:00100000:2.0:1790784480.147573:0:5803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592dac8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5803:1877773359581568:192.168.206.32@tcp:105: 00010000:00010000:2.0:1790784480.147608:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790784480.148476:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945934a17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+10:2351:x1877773344890752:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 10962us (11240us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784480.148494:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 56 00000100:00100000:3.0:1790784480.152753:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784480.152934:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344890880 00000100:00100000:2.0:1790784480.152947:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344890880 00002000:00100000:2.0:1790784480.153008:0:6674:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff945934a15c00 x1877773344890880/t0(0) o4->b0f9e8c2-ddb0-4027-babe-0b166585860c@192.168.206.32@tcp:746/0 lens 504/0 e 0 to 0 dl 1790784491 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790784480.153021:0:6674:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff945934a15c00 with x1877773344890880 ext(0->12) 00002000:00010000:2.0:1790784480.153028:0:6674:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945934a15c00 00000100:00100000:2.0:1790784480.153066:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 2 00000100:00100000:2.0:1790784480.153076:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945934a15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+10:2352:x1877773344890880:12345-192.168.206.32@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1790784480.155614:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945934a15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+12:2352:x1877773344890880:12345-192.168.206.32@tcp:4:lhsmtool_posix.0 Request processed in 2524us (2859us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1790784480.155649:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 2 00002000:00100000:2.0:1790784480.155664:0:6674:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff945934a15c00 x1877773344890880/t4294967308(0) o4->b0f9e8c2-ddb0-4027-babe-0b166585860c@192.168.206.32@tcp:746/0 lens 504/448 e 0 to 0 dl 1790784491 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790784480.155691:0:6674:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff945934a15c00 with x1877773344890880 ext(0->12) 00002000:00010000:2.0:1790784480.155700:0:6674:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945934a15c00 00000100:00100000:2.0:1790784480.163582:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784480.163702:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344891008 00000100:00100000:3.0:1790784480.163726:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344891008 00000100:00100000:3.0:1790784480.163807:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 124 00000100:00100000:3.0:1790784480.163819:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592dac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+61:10536:x1877773344891008:12345-192.168.206.32@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1790784480.242340:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967394 is committed 00000001:00080000:0.0:1790784480.242412:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:0.0:1790784480.242418:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:0.0:1790784480.242448:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:0.0:1790784480.242723:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f492d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359581696:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1790784480.242929:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784480.243008:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790784480.243015:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359581824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1790784480.243043:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784480.243074:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790784480.243083:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359581952:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790784480.243109:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784480.243145:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359581696 00000100:00100000:0.0:1790784480.243154:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359581696 00000100:00100000:0.0:1790784480.243213:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359581824 00000100:00100000:0.0:1790784480.243217:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359581824 00000100:00100000:0.0:1790784480.243228:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359581952 00000100:00100000:0.0:1790784480.243230:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359581952 00000100:00100000:0.0:1790784480.243248:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790784480.243257:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3281:x1877773359581696:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1790784480.243291:0:6669:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1790784480.243326:0:6669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d3f21 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.243352:0:6669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000176e798a/0x2c3a1e2a079d3ce3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350d8 expref: 11 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.243363:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1790784480.243416:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790784480.243421:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d3f21 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.243457:0:6669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000176e798a/0x2c3a1e2a079d3ce3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350d8 expref: 11 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.243475:0:6669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000176e798a/0x2c3a1e2a079d3ce3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350d8 expref: 11 pid: 6670 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784480.243489:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f492a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6669:1877773359582080:192.168.206.32@tcp:104: 00000100:00100000:0.0:1790784480.243558:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff945902b92b40 going to sleep for 11 seconds 00000100:00080000:0.0:1790784480.243572:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790784480.243588:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790784480.243596:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945910fc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3281:x1877773359581824:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1790784480.244186:0:6670:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1790784480.244192:0:6670:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790784479 00002000:00010000:0.0:1790784480.244194:0:6670:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790784480.244196:0:6670:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1790784479 -> 1790784479 00002000:00010000:0.0:1790784480.244199:0:6670:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1790784480.244316:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945910fc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3281:x1877773359581824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 719us (1270us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1790784480.244325:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790784480.244351:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790784480.244361:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359581952:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1790784480.244412:0:6670:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:0.0:1790784480.244449:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6abd33de, atime: 0x6abd33de, ctime: 0x6abd33de, blocks: 0xb 00010000:00010000:0.0:1790784480.244456:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab042135/0x2c3a1e2a079d3f28 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.244469:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=314s v=(0 0) 00010000:00010000:0.0:1790784480.244473:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790784480.244479:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab042135/0x2c3a1e2a079d3f28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.244495:0:6670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab042135/0x2c3a1e2a079d3f28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.244505:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab042135/0x2c3a1e2a079d3f28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.244513:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab042135/0x2c3a1e2a079d3f28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.244532:0:6670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790784480.245231:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790784480.245242:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab042135/0x2c3a1e2a079d3f28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784480.245253:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b1000 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:2.0:1790784480.245258:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab042135/0x2c3a1e2a079d3f28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784480.245269:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab042135/0x2c3a1e2a079d3f28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784480.245290:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab042135/0x2c3a1e2a079d3f28 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784480.245297:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab042135/0x2c3a1e2a079d3f28 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784480.245325:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784480.245328:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784480.245340:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784480.247813:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3280:x1877773359581952:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3445us (4693us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1790784480.247830:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790784480.248166:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592dac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+33:10536:x1877773344891008:12345-192.168.206.32@tcp:44:lhsmtool_posix.0 Request processed in 84346us (84599us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784480.248175:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 124 00000100:00100000:2.0:1790784480.248526:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1790784480.248533:0:3280:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:2.0:1790784480.248558:0:3280:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94593d7f9500, transno 4294967301 00000004:00080000:2.0:1790784480.248576:0:3280:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:2.0:1790784480.248593:0:3280:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94593f492300 x1877773359581952/t4294967304(4294967304) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790784496 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1790784480.248606:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94593f492300/2, rc 0, transno 4294967304 00000100:00100000:2.0:1790784480.248613:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359581952:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1790784480.248863:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:3.0:1790784480.248874:0:5841:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9459051ade40 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1790784480.248879:0:5841:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff945935e65e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9459051ad480 00000020:00080000:3.0:1790784480.248882:0:5841:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff945935e65900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945906875400 00000004:00080000:3.0:1790784480.248905:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1790784480.248925:0:5841:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9459051ad9c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1790784480.248929:0:5841:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff945935e65700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9459051ada80 00000020:00080000:3.0:1790784480.248931:0:5841:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff945935e65400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945907de5000 00000020:00080000:2.0:1790784480.249020:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1790784480.249239:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1790784480.251362:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784480.251592:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344891136 00000100:00100000:2.0:1790784480.251604:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344891136 00010000:00010000:2.0:1790784480.251654:0:8421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000176e798a/0x2c3a1e2a079d3ce3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350d8 expref: 12 pid: 6670 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784480.251709:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 57 00000100:00100000:2.0:1790784480.251730:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945934a14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+12:2352:x1877773344891136:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790784480.251755:0:8421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784480.251762:0:8421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000176e798a/0x2c3a1e2a079d3ce3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350d8 expref: 12 pid: 6670 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784480.251778:0:8421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000176e798a/0x2c3a1e2a079d3ce3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350d8 expref: 12 pid: 6670 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784480.251809:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790784480.251815:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790784480.251837:0:8421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d3f21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784480.251848:0:8421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d3f21 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784480.251873:0:8421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790784480.251934:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945934a14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+12:2352:x1877773344891136:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 206us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784480.251942:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 57 00000004:00080000:1.0:1790784480.252755:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94593f493800/2, rc 0, transno 4294967309 00000100:00100000:1.0:1790784480.252767:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359581824:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1790784480.253141:0:6669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000176e798a/0x2c3a1e2a079d3ce3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.32@tcp remote: 0x394e0d88381350d8 expref: 11 pid: 6670 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784480.253182:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f492a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6669:1877773359582080:192.168.206.32@tcp:104: 00010000:00010000:0.0:1790784480.253210:0:6669:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d3f21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.253222:0:6669:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d3f21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.253229:0:6669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d3f21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.253241:0:6669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d3f21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.253249:0:6669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d3f21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.253266:0:6669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790784480.253903:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790784480.253914:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d3f21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.253940:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b0400 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:3.0:1790784480.253955:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d3f21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.253967:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d3f21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.253989:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d3f21 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.253997:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d3f21 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.254021:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784480.254023:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784480.254024:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784480.254453:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3281:x1877773359581696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11193us (11520us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1790784480.254464:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790784480.254797:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784480.255193:0:8181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344891264 00000100:00100000:3.0:1790784480.255203:0:8181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344891264 00000100:00100000:3.0:1790784480.255262:0:8181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 43 00000100:00100000:3.0:1790784480.255273:0:8181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592dac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+11:2352:x1877773344891264:12345-192.168.206.32@tcp:16:lhsmtool_posix.0 00000004:00080000:1.0:1790784480.255595:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94593f492d80/2, rc 0, transno 4294967310 00000100:00100000:1.0:1790784480.255605:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f492d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359581696:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1790784480.316202:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1790784480.316234:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:1.0:1790784480.316242:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:2.0:1790784480.316458:0:8181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592dac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2352:x1877773344891264:12345-192.168.206.32@tcp:16:lhsmtool_posix.0 Request processed in 61178us (61655us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784480.316471:0:8181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 43 00000100:00100000:3.0:1790784480.318767:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784480.319558:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344891520 00000100:00100000:1.0:1790784480.319572:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344891520 00000100:00100000:1.0:1790784480.319682:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 125 00000100:00100000:1.0:1790784480.319694:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945934a15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+15:10536:x1877773344891520:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790784480.319779:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784480.319813:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3f0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813516b expref: 15 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.319838:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94592012a600) 00010000:00010000:1.0:1790784480.319844:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790784480.319881:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3f2f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.319896:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3f2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.319906:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3f2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790784480.320686:0:5819:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091f1b25a reply state 000000001844e338 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3f2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784480.320700:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790784480.320859:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945934a15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+16:10536:x1877773344891520:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 Request processed in 1165us (2105us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1790784480.320885:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 125 00010000:00010000:3.0:1790784480.322898:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3f2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.322920:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3f2f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.322947:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3f2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.322965:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955e000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784480.322972:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3f2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.322982:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3f2f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.323001:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94592012a600) 00010000:00010000:3.0:1790784480.323004:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784480.323010:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3f2f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.323017:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3f2f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784480.328490:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784480.329142:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344891648 00000100:00100000:0.0:1790784480.329156:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344891648 00000100:00100000:0.0:1790784480.329250:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 44 00000100:00100000:0.0:1790784480.329262:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2352:x1877773344891648:12345-192.168.206.32@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790784480.329615:0:6670:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1790784480.329619:0:6670:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1790784479 -> 1790784479 00002000:00010000:0.0:1790784480.329622:0:6670:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790784478 00002000:00010000:0.0:1790784480.329624:0:6670:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1790784479 -> 1790784479 00002000:00010000:0.0:1790784480.329626:0:6670:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1790784480.330043:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2352:x1877773344891648:12345-192.168.206.32@tcp:2:lhsmtool_posix.0 Request processed in 780us (1565us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1790784480.330055:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 44 00000100:00100000:2.0:1790784480.333291:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784480.333490:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344891904 00000100:00100000:1.0:1790784480.333503:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344891904 00000100:00100000:1.0:1790784480.333576:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 126 00000100:00100000:1.0:1790784480.333587:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+15:10536:x1877773344891904:12345-192.168.206.32@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1790784480.333674:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3f36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.333723:0:9249:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3ef0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813515d expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.333733:0:9249:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3f36 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.333787:0:9249:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813515d expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.333802:0:9249:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3ef0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813515d expref: 15 pid: 5818 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784480.333818:0:9249:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459056dad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9249:1877773359582208:192.168.206.32@tcp:104: 00000100:00100000:1.0:1790784480.333932:0:9249:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593fe4a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790784480.336322:0:9249:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459056dad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9249:1877773359582208:192.168.206.32@tcp:104: 00010000:00010000:1.0:1790784480.336362:0:9249:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3f36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784480.338455:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784480.338898:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344892032 00000100:00100000:1.0:1790784480.338912:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344892032 00010000:00010000:1.0:1790784480.338976:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3ef0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813515d expref: 16 pid: 5818 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784480.339034:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 58 00000100:00100000:1.0:1790784480.339046:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f495880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+16:2351:x1877773344892032:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790784480.339064:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784480.339085:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3ef0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813515d expref: 16 pid: 5818 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.339100:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813515d expref: 16 pid: 5818 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.339125:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d3ef0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813515d expref: 16 pid: 5818 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.339146:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94592012a600) 00010000:00010000:1.0:1790784480.339152:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3f36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.339164:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3f36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.339172:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3f36 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.339208:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790784480.339281:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f495880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+15:2351:x1877773344892032:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 236us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784480.339289:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 58 00010000:00010000:3.0:1790784480.339422:0:9249:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3f36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.339431:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3f36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.339469:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3f36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.339477:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3f36 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.339484:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3f36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.339498:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955e000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784480.339503:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3f36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.339512:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3f36 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.339522:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94592012a600) 00010000:00010000:3.0:1790784480.339525:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1790784480.339529:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3f36 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.339535:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d3f36 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784480.339591:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+14:10536:x1877773344891904:12345-192.168.206.32@tcp:55:lhsmtool_posix.0 Request processed in 6004us (6311us total) trans 0 rc -22/-22 00000100:00100000:3.0:1790784480.339600:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 126 00000100:00100000:2.0:1790784480.342758:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784480.342866:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344892160 00000100:00100000:0.0:1790784480.342878:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344892160 00000100:00100000:0.0:1790784480.342956:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 45 00000100:00100000:0.0:1790784480.342968:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2349:x1877773344892160:12345-192.168.206.32@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1790784480.343027:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000059587ccf/0x2c3a1e2a079d3f3d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.343050:0:6668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000089e04fac/0x2c3a1e2a079d3f1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135179 expref: 7 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.343059:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790784480.343063:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790784480.343084:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059587ccf/0x2c3a1e2a079d3f3d lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.343127:0:6668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000089e04fac/0x2c3a1e2a079d3f1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135179 expref: 7 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.343144:0:6668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000089e04fac/0x2c3a1e2a079d3f1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135179 expref: 7 pid: 6670 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784480.343161:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f493480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6668:1877773359582336:192.168.206.32@tcp:104: 00000100:00100000:0.0:1790784480.343266:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459056c9780 going to sleep for 11 seconds 00000100:00100000:0.0:1790784480.346020:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f493480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6668:1877773359582336:192.168.206.32@tcp:104: 00010000:00010000:0.0:1790784480.346060:0:6668:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000059587ccf/0x2c3a1e2a079d3f3d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784480.347740:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784480.348082:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344892288 00000100:00100000:3.0:1790784480.348094:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344892288 00010000:00010000:3.0:1790784480.348146:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000089e04fac/0x2c3a1e2a079d3f1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135179 expref: 8 pid: 6670 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784480.348192:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 59 00000100:00100000:3.0:1790784480.348202:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f495500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:2352:x1877773344892288:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790784480.348221:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784480.348253:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000089e04fac/0x2c3a1e2a079d3f1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135179 expref: 8 pid: 6670 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.348289:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000089e04fac/0x2c3a1e2a079d3f1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135179 expref: 8 pid: 6670 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.348315:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089e04fac/0x2c3a1e2a079d3f1a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135179 expref: 8 pid: 6670 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.348338:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790784480.348343:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790784480.348350:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000059587ccf/0x2c3a1e2a079d3f3d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.348362:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059587ccf/0x2c3a1e2a079d3f3d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.348462:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790784480.348530:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f495500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2352:x1877773344892288:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 328us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784480.348539:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 59 00010000:00010000:1.0:1790784480.349100:0:6668:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000059587ccf/0x2c3a1e2a079d3f3d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.349113:0:6668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059587ccf/0x2c3a1e2a079d3f3d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.349176:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000059587ccf/0x2c3a1e2a079d3f3d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.349186:0:6668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059587ccf/0x2c3a1e2a079d3f3d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.349196:0:6668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059587ccf/0x2c3a1e2a079d3f3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.349203:0:6668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b1200 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:1.0:1790784480.349207:0:6668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059587ccf/0x2c3a1e2a079d3f3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.349218:0:6668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059587ccf/0x2c3a1e2a079d3f3d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.349232:0:6668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059587ccf/0x2c3a1e2a079d3f3d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.349240:0:6668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059587ccf/0x2c3a1e2a079d3f3d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784480.349323:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2349:x1877773344892160:12345-192.168.206.32@tcp:1:lhsmtool_posix.0 Request processed in 6356us (6585us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784480.349332:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 45 00000100:00100000:2.0:1790784480.354081:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784480.354276:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344892544 00000100:00100000:3.0:1790784480.354288:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344892544 00000100:00100000:3.0:1790784480.354360:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 127 00000100:00100000:3.0:1790784480.354409:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+14:10536:x1877773344892544:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790784480.354515:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3f44 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.354538:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3f44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.354572:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3f44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.354890:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3f4b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.354904:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3efe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135164 expref: 15 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784480.354913:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3f4b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784480.355663:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3efe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135164 expref: 15 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784480.355686:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3efe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135164 expref: 15 pid: 9249 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784480.355702:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945934a15500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5820:1877773359582464:192.168.206.32@tcp:104: 00000100:00100000:2.0:1790784480.355844:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459051ad300 going to sleep for 11 seconds 00000100:00100000:3.0:1790784480.358561:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784480.358773:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945934a15500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5820:1877773359582464:192.168.206.32@tcp:104: 00010000:00010000:2.0:1790784480.358810:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3f4b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784480.358899:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344892672 00000100:00100000:0.0:1790784480.358908:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344892672 00010000:00010000:0.0:1790784480.358968:0:8480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3efe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135164 expref: 16 pid: 9249 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784480.359011:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 60 00000100:00100000:0.0:1790784480.359021:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945934a15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b0f9e8c2-ddb0-4027-babe-0b166585860c+16:2352:x1877773344892672:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790784480.359039:0:8480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784480.359048:0:8480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3efe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135164 expref: 16 pid: 9249 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.359083:0:8480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3efe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135164 expref: 16 pid: 9249 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.359109:0:8480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d3efe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135164 expref: 16 pid: 9249 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.359129:0:8480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94592012a600) 00010000:00010000:0.0:1790784480.359135:0:8480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3f4b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.359144:0:8480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3f4b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.359152:0:8480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3f4b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.359190:0:8480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790784480.359262:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945934a15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b0f9e8c2-ddb0-4027-babe-0b166585860c+15:2352:x1877773344892672:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 241us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784480.359270:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 60 00010000:00010000:2.0:1790784480.359426:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3f4b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784480.359434:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3f4b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790784480.359664:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1790784480.359839:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1790784480.359883:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1790784480.359976:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945907df7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5820:1877773359582592:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1790784480.360043:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784480.360076:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910263840 going to sleep for 11 seconds 00000100:00100000:0.0:1790784480.360435:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359582592 00000100:00100000:0.0:1790784480.360443:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359582592 00000100:00100000:0.0:1790784480.360488:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790784480.360497:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5820:x1877773359582592:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790784480.360586:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5820:x1877773359582592:12345-0@lo:1000:mdt00_002.0 Request processed in 89us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784480.360594:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790784480.360649:0:5820:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1790784480.360655:0:5820:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:0.0:1790784480.360679:0:5820:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94593f493800, transno 4294967309 00000004:00080000:0.0:1790784480.360689:0:5820:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94593f492d80, transno 4294967310 00000100:00100000:0.0:1790784480.360697:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945907df7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5820:1877773359582592:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1790784480.363105:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1790784480.367112:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f493480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5820:1877773359582720:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790784480.367204:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784480.367252:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff945902b92300 going to sleep for 11 seconds 00000100:00100000:2.0:1790784480.367350:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359582720 00000100:00100000:2.0:1790784480.367359:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359582720 00000100:00100000:2.0:1790784480.367446:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790784480.367456:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5820:x1877773359582720:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1790784480.367776:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5820:x1877773359582720:12345-0@lo:1000:mdt00_002.0 Request processed in 319us (570us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1790784480.367786:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790784480.368015:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f493480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5820:1877773359582720:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1790784480.368066:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3f4b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.368079:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3f4b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.368088:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3f4b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.368095:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901525a00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784480.368100:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3f4b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.368108:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3f4b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.368127:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94592012a600) 00010000:00010000:1.0:1790784480.368131:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790784480.368137:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3f4b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.368144:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d3f4b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.368182:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3e8e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.368190:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3e8e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.368196:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3e8e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.368218:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955f000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784480.368222:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3e8e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.368228:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3e8e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.368238:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff945903af2700) 00010000:00010000:1.0:1790784480.368240:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790784480.368248:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135148 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.368261:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e95 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135148 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.368272:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135148 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.368306:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135148 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784480.368320:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459056dad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5820:1877773359582848:192.168.206.32@tcp:105: 00000100:00100000:1.0:1790784480.368446:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593fe4a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790784480.372662:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459056dad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5820:1877773359582848:192.168.206.32@tcp:105: 00010000:00010000:1.0:1790784480.372703:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3e8e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.372756:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d3e8e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.372797:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3f52 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.372813:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3f52 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.372825:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3f52 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.372838:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3f52 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.372845:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3f52 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.372852:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3f52 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.372858:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955f400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784480.372862:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3f52 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.372869:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3f52 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.372884:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff945903af2700) 00010000:00010000:1.0:1790784480.372887:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784480.372891:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3f52 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.372904:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d3f52 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.372916:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3f44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.372922:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3f44 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.372928:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3f44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.372933:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901524000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784480.372936:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3f44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.372942:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3f44 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.372964:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff945903af2700) 00010000:00010000:1.0:1790784480.372966:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790784480.372970:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3f44 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.372975:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d3f44 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784480.373272:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+18:10536:x1877773344892544:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 Request processed in 18899us (19201us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1790784480.373284:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 127 00000020:00080000:1.0:1790784480.373298:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1790784480.373580:0:11656:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790784480.373586:0:11656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790784480.374087:0:11656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1790784480.374098:0:11656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790784480.376315:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784480.376454:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344892800 00000100:00100000:2.0:1790784480.376467:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344892800 00000100:00100000:2.0:1790784480.376533:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 31 00000100:00100000:2.0:1790784480.376544:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945934a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+18:10535:x1877773344892800:12345-192.168.206.32@tcp:49:lfs.0 00000100:00100000:2.0:1790784480.376738:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945934a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+18:10535:x1877773344892800:12345-192.168.206.32@tcp:49:lfs.0 Request processed in 194us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784480.376756:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 31 00000100:00100000:2.0:1790784480.380273:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784480.381597:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344893056 00000100:00100000:3.0:1790784480.381614:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344893056 00000100:00100000:3.0:1790784480.381685:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 32 00000100:00100000:3.0:1790784480.381696:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc15050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+18:10536:x1877773344893056:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790784480.383144:0:5821:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790784480.383266:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1790784480.383321:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3f59 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784480.383342:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3f59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784480.383356:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3f59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784480.383367:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3f59 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784480.383411:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3f59 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784480.383419:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3f59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784480.383436:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790784480.383564:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc15050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+20:10536:x1877773344893056:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 Request processed in 1865us (3300us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1790784480.383575:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 32 00000020:00080000:2.0:1790784480.383581:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790784480.383738:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790784480.383747:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3f59 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.383755:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74000 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:0.0:1790784480.383759:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3f59 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.383767:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3f59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.383781:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff945903af2400) 00010000:00010000:0.0:1790784480.383785:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790784480.383789:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3f59 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.383796:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d3f59 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.383826:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784480.383828:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784480.383829:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784480.386894:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784480.386977:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344893312 00000100:00100000:0.0:1790784480.386990:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344893312 00000100:00100000:0.0:1790784480.387059:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 128 00000100:00100000:0.0:1790784480.387070:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945934a16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+20:10535:x1877773344893312:12345-192.168.206.32@tcp:58:lfs.0 00000040:00080000:0.0:1790784480.387450:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1790784480.387551:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945934a16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+20:10535:x1877773344893312:12345-192.168.206.32@tcp:58:lfs.0 Request processed in 481us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784480.387560:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 128 00000100:00100000:3.0:1790784480.427045:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784480.427207:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344893440 00000100:00100000:0.0:1790784480.427220:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344893440 00000100:00100000:0.0:1790784480.427291:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 129 00000100:00100000:0.0:1790784480.427303:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945934a17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+20:10538:x1877773344893440:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:0.0:1790784480.427334:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784480.427359:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1e00/0x2c3a1e2a079d3f60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135180 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.427478:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d3f67 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.427496:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d3f67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.427511:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d3f67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.427551:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d3f6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.427560:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d3f6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.427567:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d3f6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.427856:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0a00/0x2c3a1e2a079d3f75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.427870:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3e80 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135141 expref: 21 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.427881:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0a00/0x2c3a1e2a079d3f75 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.427920:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3e80 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135141 expref: 21 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.427936:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3e80 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135141 expref: 21 pid: 5820 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784480.427953:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f490380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5819:1877773359582976:192.168.206.32@tcp:104: 00000100:00100000:0.0:1790784480.428071:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff945902b92f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790784480.431659:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784480.431809:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344893696 00000100:00100000:1.0:1790784480.431822:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344893696 00000100:00100000:1.0:1790784480.431891:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 33 00000100:00100000:1.0:1790784480.431902:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+22:5590:x1877773344893696:12345-192.168.206.32@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790784480.432224:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+23:5590:x1877773344893696:12345-192.168.206.32@tcp:35:ldlm_bl.0 Request processed in 322us (576us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1790784480.432232:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 33 00000100:00100000:3.0:1790784480.434833:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784480.435191:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344893824 00000100:00100000:1.0:1790784480.435204:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344893824 00010000:00010000:1.0:1790784480.435260:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3e80 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135141 expref: 23 pid: 5820 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784480.435308:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 61 00000100:00100000:1.0:1790784480.435319:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905194850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+23:2351:x1877773344893824:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790784480.435337:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784480.435344:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3e80 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135141 expref: 23 pid: 5820 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.435358:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3e80 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135141 expref: 23 pid: 5820 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.435550:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff945903af2700) 00010000:00010000:1.0:1790784480.435558:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0a00/0x2c3a1e2a079d3f75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.435571:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0a00/0x2c3a1e2a079d3f75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.435603:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0a00/0x2c3a1e2a079d3f75 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784480.435629:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790784480.435702:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905194850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+23:2351:x1877773344893824:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 384us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784480.435722:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 61 00010000:00010000:0.0:1790784480.437550:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d3e80 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135141 expref: 22 pid: 5820 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784480.437605:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f490380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5819:1877773359582976:192.168.206.32@tcp:104: 00010000:00010000:0.0:1790784480.437633:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0a00/0x2c3a1e2a079d3f75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.437644:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0a00/0x2c3a1e2a079d3f75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.437651:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0a00/0x2c3a1e2a079d3f75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790784480.437720:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1790784480.437726:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790784480.437762:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0a00/0x2c3a1e2a079d3f75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.437781:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0a00/0x2c3a1e2a079d3f75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.437793:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d3f67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.437800:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d3f67 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.437808:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d3f67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.437814:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b0600 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784480.437819:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d3f67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.437837:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d3f67 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.437854:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff945903af2300) 00010000:00010000:0.0:1790784480.437857:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784480.437862:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d3f67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.437869:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d3f67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.437880:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d3f6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.437886:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d3f6e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.437892:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d3f6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.437897:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b1a00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784480.437900:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d3f6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.437906:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d3f6e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.437913:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff945903a23300) 00010000:00010000:0.0:1790784480.437916:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784480.437919:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d3f6e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.437934:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d3f6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.437998:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1e00/0x2c3a1e2a079d3f60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135180 expref: 22 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.438014:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0a00/0x2c3a1e2a079d3f75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135180 expref: 21 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784480.438020:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff945903af2700) 00010000:00010000:0.0:1790784480.438023:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790784480.438025:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b0a00, rc 0) 00000100:00100000:0.0:1790784480.438103:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945934a17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+21:10538:x1877773344893440:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 10804us (11072us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784480.438111:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 129 00000100:00100000:3.0:1790784480.683562:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784480.683604:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784480.683636:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784480.683663:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784480.683694:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344893952 00000100:00100000:3.0:1790784480.683705:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344893952 00000100:00100000:1.0:1790784480.683753:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344894336 00000100:00100000:1.0:1790784480.683759:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344894336 00000100:00100000:3.0:1790784480.683783:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 288 00000100:00100000:1.0:1790784480.683803:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 137 00000100:00100000:3.0:1790784480.683804:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903694c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2349:x1877773344893952:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784480.683809:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945934a16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2349:x1877773344894336:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1790784480.683881:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344894080 00000100:00100000:3.0:1790784480.683882:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903694c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2349:x1877773344893952:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 80us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784480.683886:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344894080 00000100:00100000:3.0:1790784480.683889:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 288 00000100:00100000:2.0:1790784480.683926:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344894208 00000100:00100000:3.0:1790784480.683929:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 63 00000100:00100000:2.0:1790784480.683930:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344894208 00000100:00100000:3.0:1790784480.683937:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945934a16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2349:x1877773344894080:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1790784480.683949:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 64 00000100:00100000:2.0:1790784480.683956:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945934a17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2349:x1877773344894208:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784480.688826:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945934a16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2349:x1877773344894336:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 4998us (5202us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784480.688845:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 137 00000100:00080000:1.0:1790784480.688978:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790784480.688985:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790784480.689936:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945934a16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2349:x1877773344894080:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 5990us (6377us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784480.689963:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 63 00000100:00100000:2.0:1790784480.696355:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945934a17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2349:x1877773344894208:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 12380us (12671us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784480.696400:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 64 00010000:00010000:3.0:1790784480.762658:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790784481.382272:0:12022:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790784481.382287:0:12022:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790784481.382673:0:12022:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1790784481.382680:0:12022:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1790784481.405811:0:11656:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790784481.405826:0:11656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790784481.405872:0:11656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1790784481.405879:0:11656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790784481.406051:0:11656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459102e9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11656:1877773359583104:192.168.206.32@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790784481.406167:0:11656:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910263000 going to sleep for 11 seconds 00000100:00100000:0.0:1790784481.411365:0:11656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459102e9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11656:1877773359583104:192.168.206.32@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790784481.440497:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784481.440587:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344894464 00000100:00100000:1.0:1790784481.440607:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344894464 00000100:00100000:1.0:1790784481.440678:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 130 00000100:00100000:1.0:1790784481.440690:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+21:10549:x1877773344894464:12345-192.168.206.32@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790784481.440758:0:5820:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790784481.441545:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+21:10549:x1877773344894464:12345-192.168.206.32@tcp:53:lhsmtool_posix.0 Request processed in 205us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784481.441557:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 130 00000100:00100000:3.0:1790784481.452667:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784481.453901:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344894720 00000100:00100000:2.0:1790784481.453919:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344894720 00000100:00100000:2.0:1790784481.453998:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 131 00000100:00100000:2.0:1790784481.454010:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945934a17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+21:10549:x1877773344894720:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790784481.454048:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784481.454075:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d3f7c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135187 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784481.454217:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3f83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784481.454235:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3f83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784481.454266:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3f83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784481.454281:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1790784481.454475:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d3f7c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135187 expref: 24 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784481.454497:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3f83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135187 expref: 23 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784481.454506:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff945903af2700) 00010000:00010000:2.0:1790784481.454509:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790784481.454514:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe75200, rc 0) 00000100:00100000:2.0:1790784481.454618:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945934a17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+23:10549:x1877773344894720:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 610us (1965us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1790784481.454627:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 131 00000100:00100000:3.0:1790784481.457759:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784481.457812:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784481.458082:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344894976 00000100:00100000:2.0:1790784481.458095:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344894976 00000100:00100000:2.0:1790784481.458164:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 132 00000100:00100000:2.0:1790784481.458175:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945934a14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+23:10549:x1877773344894976:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790784481.458279:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d3f91 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784481.458300:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d3f91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784481.458314:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d3f91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784481.458430:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344895104 00000100:00100000:3.0:1790784481.458434:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344895104 00000100:00100000:3.0:1790784481.458479:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 8 00000100:00100000:3.0:1790784481.458486:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945934a15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+24:2350:x1877773344895104:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790784481.458497:0:8421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784481.458516:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3f83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135187 expref: 24 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784481.458532:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff945903af2700) 00010000:00010000:3.0:1790784481.458543:0:8421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790784481.458828:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d3f91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784481.458837:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d3f91 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784481.458845:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d3f91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784481.458853:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75a00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784481.458858:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d3f91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784481.458868:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d3f91 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784481.458878:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff945903af2700) 00010000:00010000:2.0:1790784481.458881:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790784481.458886:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d3f91 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784481.458892:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d3f91 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784481.459025:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945934a15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+24:2350:x1877773344895104:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 406us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784481.459035:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 8 00000100:00100000:2.0:1790784481.459036:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945934a14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+24:10549:x1877773344894976:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 Request processed in 864us (1301us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1790784481.459043:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 132 00000040:00080000:0.0:1790784481.459876:0:11656:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790784481.459884:0:11656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790784481.463065:0:11656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1790784481.463087:0:11656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790784481.465180:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784481.466341:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344895360 00000100:00100000:1.0:1790784481.466358:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344895360 00000100:00100000:1.0:1790784481.466499:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 34 00000100:00100000:1.0:1790784481.466512:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945934a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+23:10549:x1877773344895360:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790784481.467106:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945934a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+24:10549:x1877773344895360:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 Request processed in 590us (1946us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1790784481.467117:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 34 00010000:00010000:0.0:1790784481.787209:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784482.748270:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459056dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359583232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790784482.748369:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784482.748485:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359583232 00000100:00100000:3.0:1790784482.748495:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359583232 00000100:00100000:3.0:1790784482.748565:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790784482.748575:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945934a15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1877773359583232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790784482.748619:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790784482.748679:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945934a15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1877773359583232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784482.748685:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1790784482.748721:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790784482.748762:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459056dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359583232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790784482.751787:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c3a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1877773359583488:0@lo:400:kworker.0 00000100:00100000:2.0:1790784482.751885:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784482.751955:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790784482.751962:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459102e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359583360:0@lo:400:kworker.0 00000100:00100000:2.0:1790784482.751997:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784482.752044:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c3a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359583872:0@lo:400:kworker.0 00000100:00100000:2.0:1790784482.752078:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784482.752113:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359583488 00000100:00100000:2.0:1790784482.752122:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359583488 00000100:00100000:2.0:1790784482.752180:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1790784482.752190:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c3a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1877773359583488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784482.752251:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c3a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1877773359583488:12345-0@lo:400:kworker.0 Request processed in 63us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784482.752258:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1790784482.752284:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359583360 00000100:00100000:2.0:1790784482.752288:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359583360 00000100:00100000:2.0:1790784482.752312:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1790784482.752317:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3282:x1877773359583360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784482.752346:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903697850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3282:x1877773359583360:12345-0@lo:400:kworker.0 Request processed in 29us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784482.752352:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1790784482.752423:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359583872 00000100:00100000:2.0:1790784482.752427:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359583872 00000100:00100000:2.0:1790784482.752468:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790784482.752475:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c3a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3282:x1877773359583872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784482.752509:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c3a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3282:x1877773359583872:12345-0@lo:400:kworker.0 Request processed in 34us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784482.752516:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790784482.752555:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459102e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359583360:0@lo:400:kworker.0 00000100:00100000:2.0:1790784482.752583:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c3a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359583872:0@lo:400:kworker.0 00000100:00100000:2.0:1790784482.752593:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c3a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1877773359583488:0@lo:400:kworker.0 00000100:00100000:2.0:1790784482.752633:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c3a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359583616:0@lo:400:kworker.0 00000100:00100000:2.0:1790784482.752660:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784482.752683:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790784482.752689:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c3a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1877773359583744:0@lo:400:kworker.0 00000100:00100000:2.0:1790784482.752724:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784482.752750:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359583616 00000100:00100000:2.0:1790784482.752754:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359583616 00000100:00100000:2.0:1790784482.752778:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359583744 00000100:00100000:2.0:1790784482.752781:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359583744 00000100:00100000:2.0:1790784482.752800:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1790784482.752807:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c3a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359583616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784482.752846:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c3a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359583616:12345-0@lo:400:kworker.0 Request processed in 40us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784482.752852:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1790784482.752865:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1790784482.752872:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c3a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1877773359583744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784482.752901:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c3a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1877773359583744:12345-0@lo:400:kworker.0 Request processed in 30us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784482.752906:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1790784482.752939:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c3a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1877773359583744:0@lo:400:kworker.0 00000100:00100000:2.0:1790784482.752948:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c3a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359583616:0@lo:400:kworker.0 00000100:00080000:2.0:1790784482.752965:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790784482.752979:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1790784482.810952:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784483.261261:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790784483.261293:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459056dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359584000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790784483.261419:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784483.261761:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359584000 00000100:00100000:1.0:1790784483.261773:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359584000 00000100:00100000:1.0:1790784483.261844:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790784483.261856:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945934a17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1877773359584000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790784483.261903:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790784483.262119:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945934a17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1877773359584000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 264us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784483.262127:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790784483.262227:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459056dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359584000:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1790784483.535127:0:12073:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790784483.535140:0:12073:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790784483.535191:0:12073:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1790784483.535198:0:12073:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790784483.792151:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784483.792306:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344895616 00000100:00100000:0.0:1790784483.792320:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344895616 00000100:00100000:0.0:1790784483.792425:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 133 00000100:00100000:0.0:1790784483.792438:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945934a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+24:10571:x1877773344895616:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:0.0:1790784483.792489:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784483.792517:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d3f98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813518e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784483.792651:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1e00/0x2c3a1e2a079d3f9f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784483.792670:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1e00/0x2c3a1e2a079d3f9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784483.792685:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1e00/0x2c3a1e2a079d3f9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790784483.792713:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1790784483.792890:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d3f98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813518e expref: 27 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784483.792915:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1e00/0x2c3a1e2a079d3f9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813518e expref: 26 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784483.792926:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff945903af2700) 00010000:00010000:0.0:1790784483.792929:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790784483.792933:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b1e00, rc 0) 00000100:00100000:0.0:1790784483.793003:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945934a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+26:10571:x1877773344895616:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 568us (863us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1790784483.793011:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 133 00000100:00080000:3.0:1790784483.796339:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790784483.803272:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784483.805252:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344895744 00000100:00100000:3.0:1790784483.805275:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344895744 00000100:00100000:3.0:1790784483.805361:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 134 00000100:00100000:3.0:1790784483.805390:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+26:10571:x1877773344895744:12345-192.168.206.32@tcp:54:lfs.0 00010000:00010000:3.0:1790784483.805491:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3fad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784483.805512:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3fad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784483.805527:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3fad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784483.805561:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3fad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784483.805569:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3fad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784483.805577:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3fad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784483.805584:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901524600 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784483.805589:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3fad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784483.805598:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3fad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784483.805611:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff945903af2700) 00010000:00010000:3.0:1790784483.805615:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790784483.805620:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3fad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784483.805627:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d3fad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784483.805747:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+26:10571:x1877773344895744:12345-192.168.206.32@tcp:54:lfs.0 Request processed in 374us (2486us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784483.805755:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 134 00010000:00010000:1.0:1790784483.837947:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784483.930956:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784483.931126:0:8181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344895872 00000100:00100000:2.0:1790784483.931138:0:8181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344895872 00000100:00100000:2.0:1790784483.931238:0:8181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 46 00000100:00100000:2.0:1790784483.931250:0:8181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945934a15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2349:x1877773344895872:12345-192.168.206.32@tcp:101:cat.0 00010000:00010000:2.0:1790784483.931275:0:8181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784483.931301:0:8181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9d09eec/0x2c3a1e2a079d3fb4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135195 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790784483.931335:0:8181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6abd33df, atime: 0x6abd33de, ctime: 0x6abd33df, blocks: 0xb 00010000:00010000:2.0:1790784483.931361:0:8181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=318s v=(0 0) 00010000:00010000:2.0:1790784483.931366:0:8181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790784483.931425:0:8181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9d09eec/0x2c3a1e2a079d3fb4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135195 expref: 7 pid: 8181 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784483.931449:0:8181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b9d09eec/0x2c3a1e2a079d3fb4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135195 expref: 7 pid: 8181 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784483.931465:0:8181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe75e00, rc 0) 00000100:00100000:0.0:1790784483.931606:0:8181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945934a15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2349:x1877773344895872:12345-192.168.206.32@tcp:101:cat.0 Request processed in 349us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784483.931615:0:8181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 46 00000100:00080000:3.0:1790784483.931661:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790784483.936188:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784483.936671:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344896000 00000100:00100000:2.0:1790784483.936686:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344896000 00002000:00100000:3.0:1790784483.936913:0:6675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff94593f4e1c00 x1877773344896000/t0(0) o3->b0f9e8c2-ddb0-4027-babe-0b166585860c@192.168.206.32@tcp:749/0 lens 488/0 e 0 to 0 dl 1790784494 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790784483.936988:0:6675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94593f4e1c00 with x1877773344896000 ext(0->4095) 00002000:00010000:3.0:1790784483.936998:0:6675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94593f4e1c00 00000100:00100000:3.0:1790784483.937158:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 3 00000100:00100000:3.0:1790784483.937180:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2350:x1877773344896000:12345-192.168.206.32@tcp:3:cat.0 00000100:00100000:3.0:1790784483.937534:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2350:x1877773344896000:12345-192.168.206.32@tcp:3:cat.0 Request processed in 364us (1357us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1790784483.937542:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 3 00002000:00100000:3.0:1790784483.937551:0:6675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff94593f4e1c00 x1877773344896000/t0(0) o3->b0f9e8c2-ddb0-4027-babe-0b166585860c@192.168.206.32@tcp:749/0 lens 488/4536 e 0 to 0 dl 1790784494 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790784483.937561:0:6675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94593f4e1c00 with x1877773344896000 ext(0->4095) 00002000:00010000:3.0:1790784483.937565:0:6675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94593f4e1c00 00010000:00010000:2.0:1790784484.867402:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790784484.924088:0:6693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1790784485.372320:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1790784485.372343:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:3.0:1790784485.444362:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1790784485.444403:0:5841:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945908affcc0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1790784485.444407:0:5841:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94593f552b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9459056c9780 00000020:00080000:3.0:1790784485.444411:0:5841:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94593f552c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94592d610c00 00000020:00080000:3.0:1790784485.444459:0:5841:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1790784485.444475:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1790784485.444649:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:0.0:1790784485.815526:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784485.816846:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784485.816882:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784485.816904:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784485.816938:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784485.816967:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344896640 00000100:00100000:0.0:1790784485.816976:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344896640 00000100:00100000:0.0:1790784485.817029:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344896256 00000100:00100000:0.0:1790784485.817032:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344896256 00000100:00100000:0.0:1790784485.817053:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 141 00000100:00100000:0.0:1790784485.817062:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2351:x1877773344896640:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:0.0:1790784485.817125:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2351:x1877773344896640:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 66us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784485.817132:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 141 00000100:00100000:0.0:1790784485.817147:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 142 00000100:00100000:0.0:1790784485.817153:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+13:2351:x1877773344896256:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:0.0:1790784485.817174:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+13:2351:x1877773344896256:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 22us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784485.817179:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 142 00000100:00100000:0.0:1790784485.817198:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344896384 00000100:00100000:0.0:1790784485.817201:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344896384 00000100:00100000:0.0:1790784485.817222:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344896512 00000100:00100000:0.0:1790784485.817225:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344896512 00000100:00100000:0.0:1790784485.817241:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 66 00000100:00100000:0.0:1790784485.817246:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2351:x1877773344896384:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:0.0:1790784485.817276:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2351:x1877773344896384:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 30us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784485.817293:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 66 00000100:00100000:0.0:1790784485.817304:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 67 00000100:00100000:0.0:1790784485.817309:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2351:x1877773344896512:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:0.0:1790784485.817332:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2351:x1877773344896512:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 23us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784485.817337:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 67 00000100:00080000:0.0:1790784485.817350:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790784485.817354:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790784485.817356:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790784485.828431:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344896128 00000100:00100000:2.0:1790784485.828448:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344896128 00000100:00100000:2.0:1790784485.828505:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 290 00000100:00100000:2.0:1790784485.828515:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2351:x1877773344896128:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1790784485.828755:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903695450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2351:x1877773344896128:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 73us (13069us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784485.828766:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 290 00010000:00010000:1.0:1790784485.884817:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784486.915876:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790784487.610591:0:11656:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790784487.610600:0:11656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790784487.610639:0:11656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1790784487.610646:0:11656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790784487.867787:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c3a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359584128:0@lo:400:kworker.0 00000100:00100000:2.0:1790784487.867837:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c3a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359584384:0@lo:400:kworker.0 00000100:00100000:1.0:1790784487.867917:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c3a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1877773359584256:0@lo:400:kworker.0 00000100:00100000:2.0:1790784487.868865:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784487.870145:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790784487.870162:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459102e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359584512:0@lo:400:kworker.0 00000100:00100000:2.0:1790784487.870223:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784487.870284:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359584512 00000100:00100000:2.0:1790784487.870292:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359584512 00000100:00100000:2.0:1790784487.870425:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790784487.870436:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d714e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359584512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784487.870489:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d714e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359584512:12345-0@lo:400:kworker.0 Request processed in 55us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784487.870497:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1790784487.870518:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790784487.870544:0:3281:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1790784487.870550:0:3281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94593f492300, transno 4294967304 00000100:00100000:2.0:1790784487.870562:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459102e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359584512:0@lo:400:kworker.0 00000100:00100000:0.0:1790784487.876237:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784487.876438:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1877773359584640:0@lo:400:kworker.0 00000100:00100000:0.0:1790784487.876522:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784487.876575:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359584384 00000100:00100000:0.0:1790784487.876585:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359584384 00000100:00100000:0.0:1790784487.876660:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359584640 00000100:00100000:0.0:1790784487.876664:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359584640 00000100:00100000:0.0:1790784487.876700:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1790784487.876841:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1877773359584384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784487.876989:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1877773359584384:12345-0@lo:400:kworker.0 Request processed in 280us (8125us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784487.876999:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1790784487.877039:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1790784487.877046:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1877773359584640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784487.877086:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1877773359584640:12345-0@lo:400:kworker.0 Request processed in 41us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784487.877093:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790784487.878150:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784487.878196:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d716300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359584768:0@lo:400:kworker.0 00000100:00100000:1.0:1790784487.878230:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784487.879092:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359584256 00000100:00100000:1.0:1790784487.879101:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359584256 00000100:00100000:1.0:1790784487.879148:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790784487.879157:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1877773359584256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784487.879230:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1877773359584256:12345-0@lo:400:kworker.0 Request processed in 73us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784487.879238:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790784487.879261:0:8181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359584768 00000100:00100000:1.0:1790784487.879265:0:8181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359584768 00000100:00100000:1.0:1790784487.879303:0:8181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790784487.879715:0:8181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359584768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784487.879753:0:8181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359584768:12345-0@lo:400:kworker.0 Request processed in 444us (1522us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784487.879760:0:8181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790784487.879784:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790784487.879795:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459056daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359584896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790784487.879825:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784487.879855:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359584896 00000100:00100000:1.0:1790784487.879859:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359584896 00000100:00100000:1.0:1790784487.879884:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790784487.879891:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359584896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790784487.879918:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790784487.880180:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359584896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 289us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784487.880187:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790784487.880228:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459056daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359584896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790784487.880258:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c3a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1877773359584256:0@lo:400:kworker.0 00000100:00100000:1.0:1790784487.880267:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1790784487.880272:0:3280:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1790784487.880296:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d716300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359584768:0@lo:400:kworker.0 00000100:00100000:1.0:1790784487.880447:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1877773359584640:0@lo:400:kworker.0 00000100:00080000:0.0:1790784487.883128:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790784487.883143:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790784487.883212:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c3a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359584384:0@lo:400:kworker.0 00000100:00100000:2.0:1790784487.883559:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359584128 00000100:00100000:2.0:1790784487.883569:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359584128 00000100:00100000:2.0:1790784487.883658:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1790784487.883693:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3279:x1877773359584128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784487.883822:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903694450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3279:x1877773359584128:12345-0@lo:400:kworker.0 Request processed in 132us (7595us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784487.883831:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1790784487.883906:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c3a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359584128:0@lo:400:kworker.0 00010000:00010000:3.0:1790784487.931545:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784488.378870:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459056daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359585024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790784488.378973:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784488.379291:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359585024 00000100:00100000:1.0:1790784488.379302:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359585024 00000100:00100000:1.0:1790784488.379371:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790784488.379413:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d716a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359585024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790784488.379461:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790784488.379532:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d716a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359585024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784488.379541:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790784488.379640:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459056daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359585024:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790784488.955604:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784489.855351:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784489.855765:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344896768 00000100:00100000:2.0:1790784489.855774:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344896768 00000100:00100000:2.0:1790784489.855850:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 135 00000100:00100000:2.0:1790784489.855862:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+13:10223:x1877773344896768:12345-192.168.206.32@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1790784489.855985:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+13:10223:x1877773344896768:12345-192.168.206.32@tcp:60:lhsmtool_posix.0 Request processed in 125us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784489.855992:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 135 00000100:00080000:0.0:1790784489.856303:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790784489.859439:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784489.859595:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344897024 00000100:00100000:3.0:1790784489.859604:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344897024 00000100:00100000:3.0:1790784489.859676:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 35 00000100:00100000:3.0:1790784489.859686:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+13:10223:x1877773344897024:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790784489.860469:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+14:10223:x1877773344897024:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 Request processed in 782us (1037us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1790784489.860479:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 35 00010000:00010000:3.0:1790784489.979972:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790784490.483008:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1790784490.483021:0:5841:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1790784490.483051:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1790784490.483061:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1790784490.927450:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784490.927492:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784490.927523:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784490.927608:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344897664 00000100:00100000:1.0:1790784490.927618:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344897664 00000100:00100000:1.0:1790784490.927705:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 146 00000100:00100000:1.0:1790784490.927716:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2349:x1877773344897664:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784490.927783:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2349:x1877773344897664:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 69us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784490.927790:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 146 00000100:00080000:1.0:1790784490.927822:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790784490.928286:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344897408 00000100:00100000:0.0:1790784490.928291:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344897408 00000100:00100000:0.0:1790784490.928338:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 70 00000100:00100000:0.0:1790784490.928346:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2349:x1877773344897408:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:0.0:1790784490.928405:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2349:x1877773344897408:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 59us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784490.928412:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 70 00000100:00080000:1.0:1790784490.928921:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790784490.929402:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784490.929457:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784490.929544:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344897152 00000100:00100000:2.0:1790784490.929550:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344897152 00000100:00100000:2.0:1790784490.929608:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 292 00000100:00100000:2.0:1790784490.929616:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2349:x1877773344897152:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1790784490.929673:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2349:x1877773344897152:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 57us (2231us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784490.929679:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 292 00000100:00100000:0.0:1790784490.929868:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344897280 00000100:00100000:0.0:1790784490.929874:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344897280 00000100:00100000:0.0:1790784490.929918:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 147 00000100:00100000:0.0:1790784490.929925:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+13:2349:x1877773344897280:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:0.0:1790784490.929959:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+13:2349:x1877773344897280:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 34us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784490.929965:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 147 00000100:00100000:1.0:1790784490.930191:0:8181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344897536 00000100:00100000:1.0:1790784490.930195:0:8181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344897536 00000100:00100000:1.0:1790784490.930241:0:8181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 71 00000100:00100000:1.0:1790784490.930249:0:8181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2349:x1877773344897536:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784490.930278:0:8181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2349:x1877773344897536:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 31us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784490.930291:0:8181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 71 00000100:00080000:0.0:1790784490.930869:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790784491.002605:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790784491.985079:0:12277:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 12:08:10 (1790784490) 00010000:00010000:1.0:1790784492.042547:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784492.986631:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790784492.986664:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459056daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359585152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790784492.986731:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784492.986916:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359585152 00000100:00100000:1.0:1790784492.986924:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359585152 00000100:00100000:1.0:1790784492.986980:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790784492.986988:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359585152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790784492.987019:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790784492.987058:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359585152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784492.987065:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1790784492.987275:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790784492.987569:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459056daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359585152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790784492.987753:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f4e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3282:1877773359585536:0@lo:400:kworker.0 00000100:00100000:3.0:1790784492.987785:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784492.987808:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790784492.987813:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f4e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1877773359585408:0@lo:400:kworker.0 00000100:00100000:3.0:1790784492.987834:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784492.988009:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f4e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3280:1877773359585280:0@lo:400:kworker.0 00000100:00100000:2.0:1790784492.988038:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784492.988059:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f4e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359585792:0@lo:400:kworker.0 00000100:00100000:2.0:1790784492.988079:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784492.988092:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790784492.988096:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f4e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3280:1877773359585664:0@lo:400:kworker.0 00000100:00100000:2.0:1790784492.988113:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784492.988161:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359585536 00000100:00100000:3.0:1790784492.988167:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359585536 00000100:00100000:0.0:1790784492.988226:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359585280 00000100:00100000:0.0:1790784492.988229:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359585280 00000100:00100000:0.0:1790784492.988257:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1790784492.988264:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3280:x1877773359585280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784492.988314:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3280:x1877773359585280:12345-0@lo:400:kworker.0 Request processed in 50us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784492.988320:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1790784492.988344:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359585792 00000100:00100000:0.0:1790784492.988347:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359585792 00000100:00100000:1.0:1790784492.992185:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359585408 00000100:00100000:1.0:1790784492.992198:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359585408 00000100:00100000:1.0:1790784492.992244:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359585664 00000100:00100000:1.0:1790784492.992246:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359585664 00000100:00100000:2.0:1790784492.992430:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790784492.992442:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1877773359585408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784492.992522:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1877773359585408:12345-0@lo:400:kworker.0 Request processed in 82us (4687us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784492.992529:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790784492.992572:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f4e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1877773359585408:0@lo:400:kworker.0 00000100:00100000:2.0:1790784492.992600:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f4e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3280:1877773359585280:0@lo:400:kworker.0 00000100:00100000:2.0:1790784492.995689:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1790784492.995707:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1877773359585536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784492.995786:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1877773359585536:12345-0@lo:400:kworker.0 Request processed in 87us (8000us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784492.995793:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1790784492.995838:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f4e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3282:1877773359585536:0@lo:400:kworker.0 00000100:00100000:0.0:1790784492.996593:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790784492.996603:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359585792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784492.996661:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359585792:12345-0@lo:400:kworker.0 Request processed in 61us (8581us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784492.996668:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790784492.996708:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f4e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359585792:0@lo:400:kworker.0 00000100:00100000:1.0:1790784493.000992:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1790784493.001006:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1877773359585664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784493.001083:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1877773359585664:12345-0@lo:400:kworker.0 Request processed in 80us (12968us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784493.001090:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790784493.001180:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f4e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3280:1877773359585664:0@lo:400:kworker.0 00000100:00080000:3.0:1790784493.002688:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790784493.002711:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790784493.050622:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784493.504294:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790784493.504315:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459056dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359585920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790784493.504411:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784493.505089:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359585920 00000100:00100000:1.0:1790784493.505098:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359585920 00000100:00100000:1.0:1790784493.505150:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790784493.505158:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d24c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359585920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790784493.505205:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790784493.505264:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d24c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359585920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784493.505271:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790784493.505620:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459056dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359585920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790784493.563802:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784493.563985:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344897920 00000100:00100000:2.0:1790784493.563995:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344897920 00000100:00100000:2.0:1790784493.564082:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 136 00000100:00100000:2.0:1790784493.564092:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+13:11280:x1877773344897920:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790784493.564110:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784493.564130:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3fbb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813519c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784493.564196:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3fc2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784493.564210:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3fc2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784493.564221:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3fc2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784493.564235:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3fc9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784493.564242:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784493.564248:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784493.564532:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d3fd0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784493.564541:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d3fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784493.564547:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d3fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784493.564567:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00000100:00080000:3.0:1790784493.564955:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790784493.565707:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3fc2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784493.565719:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3fc2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784493.565726:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3fc2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784493.565732:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74c00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784493.565736:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3fc2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784493.568745:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3fc2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784493.568773:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff945903af2f00) 00010000:00010000:2.0:1790784493.568777:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784493.568784:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3fc2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784493.568792:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d3fc2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784493.568814:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784493.568821:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3fc9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784493.568850:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3fc9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784493.568855:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784493.568859:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3fc9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784493.568866:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3fc9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784493.568874:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff945903af2b00) 00010000:00010000:2.0:1790784493.568877:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784493.568881:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3fc9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784493.568886:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d3fc9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784493.569323:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d3fbb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813519c expref: 16 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784493.569340:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d3fd0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813519c expref: 15 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784493.569347:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94592012a400) 00010000:00010000:2.0:1790784493.569349:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784493.569352:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74e00, rc 0) 00000100:00100000:2.0:1790784493.569471:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+15:11280:x1877773344897920:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 5379us (5678us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1790784493.569488:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 136 00000100:00100000:1.0:1790784493.573364:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784493.573513:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344898048 00000100:00100000:3.0:1790784493.573523:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344898048 00000100:00100000:3.0:1790784493.573610:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 9 00000100:00100000:3.0:1790784493.573620:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+15:2350:x1877773344898048:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790784493.573634:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784493.573667:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d3fd0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813519c expref: 15 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784493.573686:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94592012a400) 00010000:00010000:3.0:1790784493.573691:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790784493.573888:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+14:2350:x1877773344898048:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 268us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784493.573896:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 9 00000100:00100000:3.0:1790784493.588903:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784493.589080:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344898176 00000100:00100000:2.0:1790784493.589092:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344898176 00000100:00100000:2.0:1790784493.589182:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 137 00000100:00100000:2.0:1790784493.589194:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+14:11280:x1877773344898176:12345-192.168.206.32@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1790784493.589344:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+14:11280:x1877773344898176:12345-192.168.206.32@tcp:59:lhsmtool_posix.0 Request processed in 152us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784493.589352:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 137 00000040:00080000:0.0:1790784493.754631:0:11656:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790784493.754649:0:11656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790784493.755271:0:11656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1790784493.755280:0:11656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1790784494.075606:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784495.098575:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790784495.642106:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000100:00100000:1.0:1790784495.869945:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784495.872716:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344898304 00000100:00100000:2.0:1790784495.872734:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344898304 00000100:00080000:3.0:1790784495.872783:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790784495.872829:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 138 00000100:00100000:2.0:1790784495.872840:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+13:11323:x1877773344898304:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:2.0:1790784495.872863:0:9249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784495.872939:0:9249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d3fde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381351a3 expref: -99 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784495.873004:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d3fe5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784495.873018:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d3fe5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784495.873031:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d3fe5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784495.873045:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3fec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784495.873064:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3fec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784495.873072:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3fec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784495.873290:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d3fe5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784495.873298:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d3fe5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784495.873305:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d3fe5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784495.873310:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75a00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784495.873314:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d3fe5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784495.873322:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d3fe5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784495.873334:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2000) 00010000:00010000:2.0:1790784495.873337:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784495.873342:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d3fe5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784495.873348:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d3fe5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784495.873359:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3fec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784495.873371:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3fec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784495.873397:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3fec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784495.873402:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75200 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784495.873405:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3fec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784495.873411:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3fec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784495.873418:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff945903af2b00) 00010000:00010000:2.0:1790784495.873421:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784495.873423:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3fec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784495.873428:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d3fec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784495.873463:0:9249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d3fde lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351a3 expref: 14 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784495.873472:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2000) 00010000:00010000:2.0:1790784495.873475:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784495.873478:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d3fde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351a3 expref: 14 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784495.873487:0:9249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74400, rc 0) 00000100:00100000:2.0:1790784495.873569:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+13:11323:x1877773344898304:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 730us (3633us total) trans 0 rc 301/301 00000100:00100000:2.0:1790784495.873576:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 138 00000100:00100000:3.0:1790784495.881153:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784495.881793:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344898560 00000100:00100000:0.0:1790784495.881803:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344898560 00000100:00100000:0.0:1790784495.881938:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 139 00000100:00100000:0.0:1790784495.881948:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+13:11323:x1877773344898560:12345-192.168.206.32@tcp:36:lfs.0 00010000:00010000:0.0:1790784495.882003:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784495.882029:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d396a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fe3 expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784495.882049:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2000) 00010000:00010000:0.0:1790784495.882059:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790784495.882811:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d3ff3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784495.883932:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d3ff3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784495.883945:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d3ff3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784495.883962:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d3ffa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784495.883970:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d3ffa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784495.883977:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d3ffa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790784495.885190:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1790784495.885205:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d3ff3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784495.885572:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d3ff3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784495.885592:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d3ff3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784495.886327:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b1c00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784495.886331:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d3ff3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784495.886340:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d3ff3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784495.886356:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903a23700) 00010000:00010000:3.0:1790784495.886359:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784495.886364:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d3ff3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784495.886370:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d3ff3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790784495.886414:0:5818:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000486a3015 reply state 00000000dd051fc1 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d3ffa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784495.886423:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790784495.886566:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+14:11323:x1877773344898560:12345-192.168.206.32@tcp:36:lfs.0 Request processed in 4615us (5417us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1790784495.886575:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 139 00010000:00010000:1.0:1790784495.895298:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d3ffa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784495.895314:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d3ffa lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784495.895323:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d3ffa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784495.895329:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b0800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784495.895334:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d3ffa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784495.895341:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d3ffa lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784495.895368:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff945903a23200) 00010000:00010000:1.0:1790784495.895371:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784495.895408:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d3ffa lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784495.895415:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d3ffa lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784496.006797:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784496.007443:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344898688 00000100:00100000:2.0:1790784496.007457:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344898688 00000100:00100000:2.0:1790784496.007531:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 140 00000100:00100000:2.0:1790784496.007543:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+13:11331:x1877773344898688:12345-192.168.206.32@tcp:101:lctl.0 00010000:00010000:2.0:1790784496.007576:0:9249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784496.007607:0:9249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d4001 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381351aa expref: -99 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.007717:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d4008 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.007733:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d4008 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.007746:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d4008 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784496.007789:0:9249:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790784496.007793:0:9249:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790784496.007813:0:9249:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d4008 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.007842:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d4001 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351aa expref: 15 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.007862:0:9249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d4008 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351aa expref: 14 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.008318:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2b00) 00010000:00010000:2.0:1790784496.008321:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790784496.008326:0:9249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe75a00, rc 0) 00000100:00100000:2.0:1790784496.009035:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+14:11331:x1877773344898688:12345-192.168.206.32@tcp:101:lctl.0 Request processed in 1487us (2246us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784496.009047:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 140 00000100:00100000:3.0:1790784496.045601:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784496.045660:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784496.046004:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784496.046051:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784496.046114:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344899200 00000100:00100000:3.0:1790784496.046126:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344899200 00000100:00100000:3.0:1790784496.046198:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 151 00000100:00100000:3.0:1790784496.046210:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2349:x1877773344899200:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1790784496.046303:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2349:x1877773344899200:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 95us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784496.046311:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 151 00000100:00080000:3.0:1790784496.046335:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790784496.047009:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344898816 00000100:00100000:2.0:1790784496.047018:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344898816 00000100:00100000:2.0:1790784496.047061:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 294 00000100:00100000:2.0:1790784496.047070:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2349:x1877773344898816:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1790784496.047117:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2349:x1877773344898816:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 48us (1530us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784496.047123:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 294 00000100:00100000:1.0:1790784496.048096:0:8181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344899072 00000100:00100000:1.0:1790784496.048109:0:8181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344899072 00000100:00080000:2.0:1790784496.049762:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790784496.050328:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344898944 00000100:00100000:0.0:1790784496.050341:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344898944 00000100:00100000:0.0:1790784496.050457:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 73 00000100:00100000:0.0:1790784496.050469:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2349:x1877773344898944:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:0.0:1790784496.050608:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2349:x1877773344898944:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 142us (4604us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784496.050617:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 73 00000100:00080000:2.0:1790784496.054095:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790784496.057702:0:8181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 74 00000100:00100000:1.0:1790784496.057724:0:8181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2349:x1877773344899072:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784496.057805:0:8181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2349:x1877773344899072:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 92us (12144us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784496.057812:0:8181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 74 00000100:00100000:3.0:1790784496.110916:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784496.113553:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344899328 00000100:00100000:1.0:1790784496.113568:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344899328 00000100:00100000:1.0:1790784496.113652:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 141 00000100:00100000:1.0:1790784496.113663:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+14:11337:x1877773344899328:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:1.0:1790784496.113682:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784496.113700:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d400f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381351b1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.113768:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d4016 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.113782:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d4016 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.113793:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d4016 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.113806:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d401d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.113813:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d401d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.113833:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d401d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.113915:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4024 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.113922:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4024 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.113929:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4024 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790784496.113954:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1790784496.113958:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790784496.113974:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4024 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.113984:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d4016 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.113991:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d4016 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.113997:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d4016 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.114003:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955e000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784496.114007:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d4016 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.114014:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d4016 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.114032:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2b00) 00010000:00010000:1.0:1790784496.114034:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784496.114039:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d4016 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.114045:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d4016 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.114060:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d401d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.114066:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d401d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.114072:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d401d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.114076:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955f400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784496.114079:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d401d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.114084:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d401d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.114091:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff94590345d700) 00010000:00010000:1.0:1790784496.114093:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784496.114096:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d401d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.114101:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d401d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.114142:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d400f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351b1 expref: 16 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.114156:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4024 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351b1 expref: 15 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.114163:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94590345dc00) 00010000:00010000:1.0:1790784496.114165:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790784496.114168:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94590955f000, rc 0) 00000100:00100000:1.0:1790784496.114258:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+15:11337:x1877773344899328:12345-192.168.206.32@tcp:101:bash.0 Request processed in 596us (3357us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784496.114265:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 141 00010000:00010000:1.0:1790784496.122607:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784496.132031:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784496.132310:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344899584 00000100:00100000:1.0:1790784496.132320:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344899584 00000100:00100000:1.0:1790784496.132414:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 142 00000100:00100000:1.0:1790784496.132425:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+15:11337:x1877773344899584:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:1.0:1790784496.132446:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784496.132466:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d402b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381351b8 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.132585:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d4032 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.132600:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d4032 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.132641:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d4032 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.135007:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d4039 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.135032:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d4039 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.135043:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d4039 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790784496.141468:0:5819:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1790784496.142989:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4040 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.143008:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4040 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.143021:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4040 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.143073:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d4032 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.143081:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d4032 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.143088:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d4032 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.143093:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955f400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784496.143108:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d4032 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.143115:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d4032 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.143127:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94590345dc00) 00010000:00010000:1.0:1790784496.143130:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784496.143136:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d4032 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.143142:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f400/0x2c3a1e2a079d4032 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790784496.143156:0:5819:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d974b83c reply state 00000000a20c99b1 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d4039 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784496.143165:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790784496.143218:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f800/0x2c3a1e2a079d402b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351b8 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.143233:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4040 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351b8 expref: 17 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.143241:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94590345dd00) 00010000:00010000:1.0:1790784496.143243:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790784496.143246:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945900031c00, rc 0) 00000100:00100000:1.0:1790784496.143329:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+18:11337:x1877773344899584:12345-192.168.206.32@tcp:101:bash.0 Request processed in 10906us (11306us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1790784496.143337:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 142 00010000:00010000:3.0:1790784496.155580:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d4039 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784496.155595:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d4039 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784496.155603:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d4039 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784496.155609:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955e000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784496.155614:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d4039 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784496.155621:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d4039 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784496.155647:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94590345d700) 00010000:00010000:3.0:1790784496.155650:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784496.155655:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d4039 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784496.155691:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e000/0x2c3a1e2a079d4039 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784496.158315:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784496.158442:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344899712 00000100:00100000:1.0:1790784496.158454:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344899712 00000100:00100000:1.0:1790784496.158521:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 47 00000100:00100000:1.0:1790784496.158532:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2351:x1877773344899712:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:1.0:1790784496.158560:0:6668:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784496.158592:0:6668:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d404e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381351bf expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790784496.158642:0:6668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790784496.158665:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=330s v=(0 0) 00010000:00010000:1.0:1790784496.158670:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784496.158680:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d404e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351bf expref: 6 pid: 6668 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.158701:0:6668:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d404e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351bf expref: 6 pid: 6668 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.158722:0:6668:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945900030000, rc 0) 00000100:00100000:1.0:1790784496.158790:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2351:x1877773344899712:12345-192.168.206.32@tcp:101:bash.0 Request processed in 260us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784496.158796:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 47 00000100:00100000:0.0:1790784496.161675:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784496.161853:0:8181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344899840 00000100:00100000:1.0:1790784496.161862:0:8181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344899840 00000100:00100000:1.0:1790784496.161920:0:8181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 48 00000100:00100000:1.0:1790784496.161929:0:8181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:11337:x1877773344899840:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:1.0:1790784496.161945:0:8181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784496.161973:0:8181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9850aec/0x2c3a1e2a079d4055 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381351c6 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.162001:0:8181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d404e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351bf expref: 7 pid: 6668 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.162010:0:8181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784496.162015:0:8181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784496.162020:0:8181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9850aec/0x2c3a1e2a079d4055 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351c6 expref: 7 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.162049:0:8181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d404e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381351bf expref: 7 pid: 6668 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.162063:0:8181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d404e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381351bf expref: 7 pid: 6668 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784496.162076:0:8181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459056daa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8181:1877773359586048:192.168.206.32@tcp:104: 00000100:00100000:1.0:1790784496.162165:0:8181:0:(client.c:2716:ptlrpc_set_wait()) set ffff945904fd7600 going to sleep for 11 seconds 00000100:00100000:2.0:1790784496.164800:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784496.165100:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344899968 00000100:00100000:3.0:1790784496.165108:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344899968 00010000:00010000:3.0:1790784496.165153:0:8421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d404e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381351bf expref: 8 pid: 6668 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784496.165192:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 62 00000100:00100000:3.0:1790784496.165361:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d717100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:2352:x1877773344899968:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790784496.165408:0:8421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784496.165430:0:8421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d404e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381351bf expref: 8 pid: 6668 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784496.165444:0:8421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d404e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381351bf expref: 8 pid: 6668 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784496.165466:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784496.165470:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784496.165478:0:8421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a9850aec/0x2c3a1e2a079d4055 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351c6 expref: 8 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784496.165603:0:8421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9850aec/0x2c3a1e2a079d4055 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351c6 expref: 8 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.165807:0:8181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d404e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381351bf expref: 8 pid: 6668 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784496.165822:0:8181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459056daa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8181:1877773359586048:192.168.206.32@tcp:104: 00010000:00010000:1.0:1790784496.165846:0:8181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a9850aec/0x2c3a1e2a079d4055 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351c6 expref: 7 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.165871:0:8181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945900030e00, rc 0) 00000100:00100000:1.0:1790784496.165930:0:8181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:11337:x1877773344899840:12345-192.168.206.32@tcp:101:bash.0 Request processed in 4002us (4262us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784496.165938:0:8181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 48 00010000:00010000:2.0:1790784496.166708:0:8421:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a9850aec/0x2c3a1e2a079d4055 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351c6 expref: 6 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784496.166736:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d715c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8421:1877773359586176:192.168.206.32@tcp:105: 00000100:00100000:2.0:1790784496.166802:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593f57f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790784496.175413:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d715c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8421:1877773359586176:192.168.206.32@tcp:105: 00010000:00010000:0.0:1790784496.175438:0:8421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790784496.175503:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d717100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2352:x1877773344899968:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 10302us (10710us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784496.175513:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 62 00000100:00100000:3.0:1790784496.178451:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784496.178602:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344900224 00000100:00100000:2.0:1790784496.178612:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344900224 00000100:00100000:2.0:1790784496.178681:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 36 00000100:00100000:2.0:1790784496.178692:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+17:11337:x1877773344900224:12345-192.168.206.32@tcp:35:bash.0 00000001:00080000:2.0:1790784496.178976:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967418 00000100:00100000:2.0:1790784496.179082:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+19:11337:x1877773344900224:12345-192.168.206.32@tcp:35:bash.0 Request processed in 391us (639us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1790784496.179089:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 36 00000020:00080000:2.0:1790784496.179094:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790784496.289216:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784496.289660:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344900480 00000100:00100000:1.0:1790784496.289674:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344900480 00000100:00100000:1.0:1790784496.290245:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 143 00000100:00100000:1.0:1790784496.290258:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+19:11347:x1877773344900480:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:1.0:1790784496.290281:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784496.290300:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d405c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381351cd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790784496.290431:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1790784496.290539:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d405c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351cd expref: 21 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.290553:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2b00) 00010000:00010000:1.0:1790784496.290556:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790784496.290562:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d405c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351cd expref: 21 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.290578:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945900030000, rc 0) 00000100:00100000:1.0:1790784496.290650:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+20:11347:x1877773344900480:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 395us (1449us total) trans 4294967420 rc 301/301 00000100:00100000:1.0:1790784496.290657:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 143 00000100:00100000:2.0:1790784496.300937:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784496.301101:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344900736 00000100:00100000:1.0:1790784496.301112:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344900736 00000100:00100000:1.0:1790784496.301179:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 37 00000100:00100000:1.0:1790784496.301190:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+20:11347:x1877773344900736:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:1.0:1790784496.302600:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+21:11347:x1877773344900736:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 1405us (1664us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1790784496.302613:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 37 00000100:00100000:3.0:1790784496.376023:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784496.376131:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344900864 00000100:00100000:2.0:1790784496.376141:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344900864 00000100:00100000:2.0:1790784496.376415:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 144 00000100:00100000:2.0:1790784496.376427:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459349f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+21:11353:x1877773344900864:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:2.0:1790784496.376450:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784496.376468:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d406a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381351d4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.376528:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d4071 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.376541:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d4071 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.376551:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d4071 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784496.376582:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1790784496.376585:0:5818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790784496.376600:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d4071 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.376622:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d406a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351d4 expref: 23 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.376664:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d4071 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351d4 expref: 22 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.376685:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94590345dc00) 00010000:00010000:2.0:1790784496.376688:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790784496.376692:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74800, rc 0) 00000100:00100000:2.0:1790784496.376754:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459349f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+22:11353:x1877773344900864:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 330us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784496.376760:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 144 00000100:00100000:3.0:1790784496.382197:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784496.382336:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344901120 00000100:00100000:2.0:1790784496.382345:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344901120 00000100:00100000:2.0:1790784496.382435:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 145 00000100:00100000:2.0:1790784496.382447:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459349f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+22:11353:x1877773344901120:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:2.0:1790784496.382467:0:9249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784496.382485:0:9249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d4078 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381351db expref: -99 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.382582:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d407f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.382596:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d407f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.382607:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d407f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784496.382618:0:9249:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1790784496.382775:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d4078 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351db expref: 25 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.382792:0:9249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d407f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351db expref: 24 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.382800:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94590345dd00) 00010000:00010000:2.0:1790784496.382803:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790784496.382807:0:9249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74000, rc 0) 00000100:00100000:2.0:1790784496.382873:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459349f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+24:11353:x1877773344901120:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 420us (676us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1790784496.382881:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 145 00000100:00100000:0.0:1790784496.387396:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784496.387472:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344901376 00000100:00100000:2.0:1790784496.387481:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344901376 00000100:00100000:2.0:1790784496.387525:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 146 00000100:00100000:2.0:1790784496.387534:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+24:11353:x1877773344901376:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:2.0:1790784496.387556:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784496.387575:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d408d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381351e2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.387940:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d4094 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.387955:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d4094 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.387967:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d4094 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784496.387998:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1790784496.388123:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d408d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351e2 expref: 27 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.388142:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d4094 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351e2 expref: 26 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.388150:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94590345dd00) 00010000:00010000:2.0:1790784496.388153:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790784496.388156:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe75400, rc 0) 00000100:00100000:2.0:1790784496.388220:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+26:11353:x1877773344901376:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 686us (857us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1790784496.388228:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 146 00000100:00100000:3.0:1790784496.388692:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784496.388820:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344901504 00000100:00100000:2.0:1790784496.388826:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344901504 00000100:00100000:2.0:1790784496.388885:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 10 00000100:00100000:2.0:1790784496.388894:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459349f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+26:2351:x1877773344901504:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790784496.388906:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784496.388921:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d407f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351db expref: 26 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.388934:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94590345dd00) 00010000:00010000:2.0:1790784496.388938:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790784496.388977:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459349f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+25:2351:x1877773344901504:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 83us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784496.388984:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 10 00000100:00100000:3.0:1790784496.394570:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784496.395478:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344901632 00000100:00100000:1.0:1790784496.395488:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344901632 00000100:00100000:1.0:1790784496.395611:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 49 00000100:00100000:1.0:1790784496.395622:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459349f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2349:x1877773344901632:12345-192.168.206.32@tcp:1:lfs.0 00010000:00010000:1.0:1790784496.395685:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d40a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.395705:0:6668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a9850aec/0x2c3a1e2a079d4055 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351c6 expref: 6 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.395713:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784496.395717:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790784496.395722:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d40a2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.395756:0:6668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a9850aec/0x2c3a1e2a079d4055 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381351c6 expref: 6 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.395782:0:6668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a9850aec/0x2c3a1e2a079d4055 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381351c6 expref: 6 pid: 8181 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784496.395831:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459056daa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6668:1877773359586304:192.168.206.32@tcp:104: 00000100:00100000:1.0:1790784496.395989:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff945904fd7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790784496.398033:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459056daa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6668:1877773359586304:192.168.206.32@tcp:104: 00000100:00100000:3.0:1790784496.398247:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00010000:00010000:1.0:1790784496.398481:0:6668:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d40a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784496.398494:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344901760 00000100:00100000:0.0:1790784496.398501:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344901760 00002000:00100000:0.0:1790784496.398542:0:6673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9459349f7b80 x1877773344901760/t0(0) o4->b0f9e8c2-ddb0-4027-babe-0b166585860c@192.168.206.32@tcp:7/0 lens 504/0 e 0 to 0 dl 1790784507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790784496.398552:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9459349f7b80 with x1877773344901760 ext(0->12) 00010000:00010000:0.0:1790784496.398559:0:6673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a9850aec/0x2c3a1e2a079d4055 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381351c6 expref: 7 pid: 8181 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784496.398573:0:6673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a9850aec/0x2c3a1e2a079d4055 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381351c6 expref: 7 pid: 8181 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790784496.398580:0:6673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9459349f7b80 00000100:00100000:0.0:1790784496.398655:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 2 00000100:00100000:0.0:1790784496.398677:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459349f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2352:x1877773344901760:12345-192.168.206.32@tcp:4:lfs.0 00000100:00100000:0.0:1790784496.399164:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459349f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+9:2352:x1877773344901760:12345-192.168.206.32@tcp:4:lfs.0 Request processed in 498us (915us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1790784496.399178:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 2 00002000:00100000:0.0:1790784496.399186:0:6673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9459349f7b80 x1877773344901760/t4294967305(0) o4->b0f9e8c2-ddb0-4027-babe-0b166585860c@192.168.206.32@tcp:7/0 lens 504/448 e 0 to 0 dl 1790784507 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790784496.399194:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9459349f7b80 with x1877773344901760 ext(0->12) 00010000:00010000:0.0:1790784496.399200:0:6673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a9850aec/0x2c3a1e2a079d4055 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381351c6 expref: 9 pid: 8181 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784496.399210:0:6673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a9850aec/0x2c3a1e2a079d4055 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381351c6 expref: 9 pid: 8181 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790784496.399217:0:6673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9459349f7b80 00000100:00100000:3.0:1790784496.401156:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784496.401280:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344901888 00000100:00100000:2.0:1790784496.401288:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344901888 00010000:00010000:2.0:1790784496.401321:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a9850aec/0x2c3a1e2a079d4055 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381351c6 expref: 9 pid: 8181 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784496.401362:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 63 00000100:00100000:2.0:1790784496.401409:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459349f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+9:2349:x1877773344901888:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790784496.401424:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1790784496.401440:0:5803:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1790784496.401443:0:5803:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790784496 00002000:00010000:2.0:1790784496.401445:0:5803:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790784496 00002000:00010000:2.0:1790784496.401447:0:5803:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1790784496 00010000:00010000:2.0:1790784496.401453:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a9850aec/0x2c3a1e2a079d4055 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381351c6 expref: 9 pid: 8181 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.401467:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a9850aec/0x2c3a1e2a079d4055 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381351c6 expref: 9 pid: 8181 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.401488:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9850aec/0x2c3a1e2a079d4055 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381351c6 expref: 9 pid: 8181 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.401505:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790784496.401509:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790784496.401514:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d40a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.401524:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d40a2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.401559:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790784496.401710:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459349f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:2349:x1877773344901888:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 339us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784496.401718:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 63 00010000:00010000:1.0:1790784496.401790:0:6668:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d40a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.401801:0:6668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d40a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.401838:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d40a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.401848:0:6668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d40a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.401856:0:6668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d40a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.401872:0:6668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030000 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:1.0:1790784496.401877:0:6668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d40a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.401898:0:6668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d40a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.401912:0:6668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d40a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.401919:0:6668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d40a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784496.401963:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459349f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2349:x1877773344901632:12345-192.168.206.32@tcp:1:lfs.0 Request processed in 6343us (7402us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784496.401970:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 49 00000100:00100000:3.0:1790784496.406107:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784496.406278:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344902144 00000100:00100000:1.0:1790784496.406288:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344902144 00000100:00100000:1.0:1790784496.406350:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 38 00000100:00100000:1.0:1790784496.406360:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc14050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+25:11353:x1877773344902144:12345-192.168.206.32@tcp:35:lfs.0 00000004:00010000:1.0:1790784496.406565:0:5822:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d4094 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351e2 expref: 25 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790784496.406959:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1790784496.407004:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1790784496.407568:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:1.0:1790784496.407641:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d40a9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.407659:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4040 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351b8 expref: 29 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.407751:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d40a9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.407786:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4040 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381351b8 expref: 29 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.407801:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4040 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381351b8 expref: 29 pid: 5819 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784496.407815:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459056daa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5822:1877773359586432:192.168.206.32@tcp:104: 00000100:00100000:1.0:1790784496.408020:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff945904fd7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790784496.410129:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459056daa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5822:1877773359586432:192.168.206.32@tcp:104: 00010000:00010000:1.0:1790784496.410157:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d40a9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784496.410636:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784496.410813:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344902272 00000100:00100000:0.0:1790784496.410821:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344902272 00010000:00010000:0.0:1790784496.410855:0:8421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4040 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381351b8 expref: 30 pid: 5819 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784496.410895:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 64 00000100:00100000:0.0:1790784496.410904:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459349f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+30:2351:x1877773344902272:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790784496.410918:0:8421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784496.410926:0:8421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4040 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381351b8 expref: 30 pid: 5819 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784496.410940:0:8421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4040 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381351b8 expref: 30 pid: 5819 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784496.410961:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4040 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381351b8 expref: 30 pid: 5819 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784496.410986:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94590345dd00) 00010000:00010000:0.0:1790784496.410991:0:8421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d40a9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784496.411000:0:8421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d40a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784496.411009:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d40a9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784496.411083:0:8421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790784496.411133:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459349f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+29:2351:x1877773344902272:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 230us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784496.411151:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 64 00010000:00010000:1.0:1790784496.411275:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d40a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.411284:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d40a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790784496.411608:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:1.0:1790784496.412001:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1790784496.412097:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459056daa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5822:1877773359586560:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790784496.412182:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784496.412248:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff945904fd7300 going to sleep for 11 seconds 00000100:00100000:0.0:1790784496.412286:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359586560 00000100:00100000:0.0:1790784496.412292:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359586560 00000100:00100000:0.0:1790784496.412352:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790784496.412361:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906a71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5822:x1877773359586560:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790784496.412513:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906a71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5822:x1877773359586560:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 152us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784496.412522:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790784496.412549:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459056daa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5822:1877773359586560:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:2.0:1790784496.412608:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1790784496.413020:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1790784496.413158:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906a72300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5822:1877773359586688:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790784496.413290:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784496.413365:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff945904fd7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790784496.413447:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359586688 00000100:00100000:0.0:1790784496.413452:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359586688 00000100:00100000:0.0:1790784496.413482:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790784496.413489:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906a72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5822:x1877773359586688:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790784496.413648:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906a72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5822:x1877773359586688:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 159us (358us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1790784496.413665:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790784496.413728:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906a72300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5822:1877773359586688:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1790784496.413769:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1790784496.413802:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d40a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.413811:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d40a9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.413818:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d40a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.413823:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030c00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784496.413827:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d40a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.413833:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d40a9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.413847:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94590345dd00) 00010000:00010000:1.0:1790784496.413850:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1790784496.413854:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d40a9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.413860:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d40a9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790784496.413998:0:5822:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1790784496.414344:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1790784496.414355:0:5822:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 330563979528ns, next at 331563977333ns, rc = 0 00000001:00080000:1.0:1790784496.414361:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1790784496.414541:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94590345dd00) 00010000:00010000:1.0:1790784496.414545:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790784496.414551:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d4094 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351e2 expref: 33 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784496.414662:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc14050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+32:11353:x1877773344902144:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 8303us (8563us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1790784496.414670:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 38 00000020:00080000:1.0:1790784496.414675:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1790784496.419282:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784496.421905:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344902400 00000100:00100000:2.0:1790784496.421918:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344902400 00000100:00100000:1.0:1790784496.422551:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 147 00000100:00100000:1.0:1790784496.422566:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459349f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+32:11353:x1877773344902400:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:1.0:1790784496.422593:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784496.422618:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d40b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381351e9 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.422928:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d40b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351e9 expref: 33 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.422943:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d40b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351e9 expref: 33 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.422963:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94590345d200) 00010000:00010000:1.0:1790784496.422966:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790784496.422970:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945900030000, rc 0) 00000100:00100000:1.0:1790784496.423036:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459349f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+33:11353:x1877773344902400:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 475us (3777us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784496.423058:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 147 00000100:00100000:3.0:1790784496.427044:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784496.427673:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344902656 00000100:00100000:2.0:1790784496.427686:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344902656 00000100:00100000:2.0:1790784496.427747:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 39 00000100:00100000:2.0:1790784496.427758:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459349f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+33:11353:x1877773344902656:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:2.0:1790784496.428054:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459349f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+34:11353:x1877773344902656:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 296us (1020us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1790784496.428063:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 39 00000100:00100000:3.0:1790784496.524161:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784496.524318:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344902912 00000100:00100000:2.0:1790784496.524328:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344902912 00000100:00100000:2.0:1790784496.524430:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 148 00000100:00100000:2.0:1790784496.524441:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459349f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+34:11363:x1877773344902912:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:2.0:1790784496.524466:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784496.524486:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d40b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381351f0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784496.524572:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1790784496.524708:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d40b7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351f0 expref: 36 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.524741:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2b00) 00010000:00010000:2.0:1790784496.524744:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790784496.524749:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d40b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351f0 expref: 36 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.524763:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74000, rc 0) 00000100:00100000:2.0:1790784496.524827:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459349f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+35:11363:x1877773344902912:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 387us (674us total) trans 4294967434 rc 301/301 00000100:00100000:2.0:1790784496.524834:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 148 00000100:00100000:3.0:1790784496.530733:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784496.530817:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344903040 00000100:00100000:2.0:1790784496.530827:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344903040 00000100:00100000:2.0:1790784496.530897:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 149 00000100:00100000:2.0:1790784496.530908:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459349f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+35:11363:x1877773344903040:12345-192.168.206.32@tcp:34:lfs.0 00010000:00010000:2.0:1790784496.530992:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d40c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.531007:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d40c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.531018:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d40c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.531030:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d40cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.531037:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d40cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.531060:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d40cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.531150:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d40d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.531159:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d40d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.531175:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d40d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790784496.531218:0:9249:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d40d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.531230:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d40c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.531236:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d40c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.531243:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d40c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.531248:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784496.531252:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d40c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.531259:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d40c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.531270:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94590345dc00) 00010000:00010000:2.0:1790784496.531279:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784496.531284:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d40c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.531290:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d40c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.531303:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d40cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.531310:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d40cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.531316:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d40cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.531321:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74c00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784496.531324:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d40cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.531330:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d40cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.531337:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff945903af2a00) 00010000:00010000:2.0:1790784496.531340:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784496.531343:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d40cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.531348:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d40cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.531361:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d40d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.531372:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d40d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.531417:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d40d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.531422:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784496.531425:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d40d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.531430:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d40d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.531437:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94590345d200) 00010000:00010000:2.0:1790784496.531439:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784496.531442:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d40d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.531447:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d40d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784496.531523:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459349f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+35:11363:x1877773344903040:12345-192.168.206.32@tcp:34:lfs.0 Request processed in 617us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784496.531531:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 149 00000100:00100000:3.0:1790784496.535012:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784496.535196:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344903296 00000100:00100000:1.0:1790784496.535207:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344903296 00000100:00100000:1.0:1790784496.535258:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 40 00000100:00100000:1.0:1790784496.535268:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459349f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+35:11363:x1877773344903296:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:1.0:1790784496.535524:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459349f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+36:11363:x1877773344903296:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 257us (522us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1790784496.535531:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 40 00000100:00100000:3.0:1790784496.583098:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784496.583805:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344903552 00000100:00100000:1.0:1790784496.583815:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344903552 00000100:00100000:1.0:1790784496.583991:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 150 00000100:00100000:1.0:1790784496.584002:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459349f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+36:11366:x1877773344903552:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:1.0:1790784496.584027:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784496.584049:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d40da lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381351f7 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.584123:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d40e1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.584138:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d40e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.584150:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d40e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.584166:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d40e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.584317:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d40e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.584325:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d40e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.584466:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d40ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.584475:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d40ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.584482:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d40ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790784496.584491:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1790784496.584582:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d40e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.584590:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d40e1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.584596:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d40e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.584602:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900031800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784496.584607:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d40e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.584614:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d40e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.584648:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94590345dc00) 00010000:00010000:1.0:1790784496.584651:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784496.584656:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d40e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.584824:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d40e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.584841:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d40e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.584847:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d40e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.584853:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d40e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.584858:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900031c00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784496.585025:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d40e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.585033:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d40e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.585041:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94590345dd00) 00010000:00010000:1.0:1790784496.585043:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784496.585046:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d40e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.585052:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d40e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.585109:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d40da lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351f7 expref: 39 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.585123:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d40ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351f7 expref: 38 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.585129:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94590345d200) 00010000:00010000:1.0:1790784496.585131:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790784496.585134:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945900030e00, rc 0) 00000100:00100000:1.0:1790784496.585356:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459349f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+38:11366:x1877773344903552:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 1355us (2266us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1790784496.585365:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 150 00000100:00100000:3.0:1790784496.590018:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784496.590232:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344903680 00000100:00100000:2.0:1790784496.590242:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344903680 00000100:00100000:2.0:1790784496.590342:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 151 00000100:00100000:2.0:1790784496.590352:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459349f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+38:11366:x1877773344903680:12345-192.168.206.32@tcp:54:lfs.0 00010000:00010000:2.0:1790784496.590448:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d40fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.590479:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d40fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.590491:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d40fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.590522:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d40fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.590530:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d40fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.590537:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d40fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.590543:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784496.590547:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d40fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.590553:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d40fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.590564:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94590345d200) 00010000:00010000:2.0:1790784496.590566:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790784496.590571:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d40fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.590575:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d40fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784496.590658:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459349f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+38:11366:x1877773344903680:12345-192.168.206.32@tcp:54:lfs.0 Request processed in 308us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784496.591087:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 151 00000100:00100000:3.0:1790784496.592430:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784496.592601:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344903936 00000100:00100000:1.0:1790784496.592609:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344903936 00000100:00100000:1.0:1790784496.592675:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 41 00000100:00100000:1.0:1790784496.592686:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459349f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+38:11366:x1877773344903936:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:1.0:1790784496.592944:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459349f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+39:11366:x1877773344903936:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 259us (516us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1790784496.592960:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 41 00000100:00100000:3.0:1790784496.854650:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784496.854772:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344904192 00000100:00100000:2.0:1790784496.854782:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344904192 00000100:00100000:2.0:1790784496.854853:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 152 00000100:00100000:2.0:1790784496.854873:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459349f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+39:11397:x1877773344904192:12345-192.168.206.32@tcp:101:cat.0 00010000:00010000:2.0:1790784496.854897:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784496.854917:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d4104 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381351fe expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.855007:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d410b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.855021:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d410b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.855034:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d410b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784496.855046:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1790784496.855165:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d4104 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351fe expref: 42 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.855184:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d410b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351fe expref: 41 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.855193:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94590345d200) 00010000:00010000:2.0:1790784496.855196:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790784496.855199:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74c00, rc 0) 00000100:00100000:2.0:1790784496.855270:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459349f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+41:11397:x1877773344904192:12345-192.168.206.32@tcp:101:cat.0 Request processed in 408us (627us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1790784496.855278:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 152 00000100:00100000:3.0:1790784496.860350:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784496.860517:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784496.861128:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344904448 00000100:00100000:1.0:1790784496.861143:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344904448 00000100:00100000:1.0:1790784496.861449:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 42 00000100:00100000:1.0:1790784496.861462:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459349f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+41:11397:x1877773344904448:12345-192.168.206.32@tcp:35:cat.0 00000100:00100000:0.0:1790784496.861781:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344904576 00000100:00100000:0.0:1790784496.861797:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344904576 00000100:00100000:1.0:1790784496.861887:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459349f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+43:11397:x1877773344904448:12345-192.168.206.32@tcp:35:cat.0 Request processed in 424us (1546us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1790784496.861897:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 11 00000100:00100000:0.0:1790784496.861909:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905197450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+43:2351:x1877773344904576:12345-192.168.206.32@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790784496.861932:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 42 00010000:00010000:0.0:1790784496.861933:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784496.861960:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d410b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351fe expref: 43 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784496.861985:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94590345d200) 00010000:00010000:0.0:1790784496.861990:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790784496.862044:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905197450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+42:2351:x1877773344904576:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 136us (1525us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784496.862052:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 11 00000100:00100000:3.0:1790784496.914553:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784496.914708:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344904832 00000100:00100000:1.0:1790784496.914723:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344904832 00000100:00100000:1.0:1790784496.914809:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 153 00000100:00100000:1.0:1790784496.914822:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459349f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+41:11403:x1877773344904832:12345-192.168.206.32@tcp:101:dd.0 00010000:00010000:1.0:1790784496.914857:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784496.914870:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790784496.914905:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d4071 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351d4 expref: 41 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.914931:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94590345dc00) 00010000:00010000:1.0:1790784496.914937:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790784496.914954:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d4119 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135205 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.915084:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4120 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.915100:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d40ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351f7 expref: 41 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.915109:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4120 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.915148:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d40ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381351f7 expref: 41 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.915163:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d40ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381351f7 expref: 41 pid: 5819 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784496.915198:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945907df7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5820:1877773359586816:192.168.206.32@tcp:104: 00000100:00100000:1.0:1790784496.915326:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff945904fd7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790784496.919074:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945907df7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5820:1877773359586816:192.168.206.32@tcp:104: 00010000:00010000:1.0:1790784496.919115:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4120 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784496.920809:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784496.920927:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344904960 00000100:00100000:2.0:1790784496.920940:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344904960 00010000:00010000:2.0:1790784496.920993:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d40ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381351f7 expref: 42 pid: 5819 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784496.921045:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 65 00000100:00100000:2.0:1790784496.921057:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459349f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+42:2352:x1877773344904960:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790784496.921075:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784496.921083:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d40ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381351f7 expref: 42 pid: 5819 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.921098:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d40ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381351f7 expref: 42 pid: 5819 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.921124:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d40ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381351f7 expref: 42 pid: 5819 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.921145:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94590345d200) 00010000:00010000:2.0:1790784496.921155:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4120 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.921177:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4120 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.921187:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4120 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.921246:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790784496.921316:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459349f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+41:2352:x1877773344904960:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 261us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784496.921324:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 65 00010000:00010000:3.0:1790784496.922817:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4120 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784496.922835:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4120 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790784496.922893:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1790784496.923096:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d4119 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135205 expref: 42 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784496.923122:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4120 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135205 expref: 41 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784496.923131:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94590345d200) 00010000:00010000:3.0:1790784496.923135:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790784496.923139:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945900031c00, rc 0) 00000100:00100000:3.0:1790784496.923235:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459349f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+41:11403:x1877773344904832:12345-192.168.206.32@tcp:101:dd.0 Request processed in 8415us (8695us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1790784496.923245:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 153 00000100:00100000:3.0:1790784496.931503:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784496.939908:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344905216 00000100:00100000:2.0:1790784496.939929:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344905216 00000100:00100000:2.0:1790784496.940177:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 154 00000100:00100000:2.0:1790784496.940191:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459349f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+41:11403:x1877773344905216:12345-192.168.206.32@tcp:36:dd.0 00010000:00010000:2.0:1790784496.941077:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d412e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.941101:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d412e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784496.941115:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d412e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790784496.941180:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:2.0:1790784496.941206:0:5818:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c93a50d3 reply state 0000000015a0effa transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d412e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784496.941217:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790784496.941698:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459349f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+44:11403:x1877773344905216:12345-192.168.206.32@tcp:36:dd.0 Request processed in 1505us (10203us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1790784496.941709:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 154 00000020:00080000:2.0:1790784496.941717:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790784496.947135:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d412e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.947158:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d412e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.947167:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d412e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.947174:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784496.947181:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d412e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.947189:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d412e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.947211:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94590345d200) 00010000:00010000:1.0:1790784496.947214:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784496.947221:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d412e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784496.947227:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75800/0x2c3a1e2a079d412e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.149898:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784497.292461:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784497.292978:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344905344 00000100:00100000:2.0:1790784497.292991:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344905344 00000100:00100000:2.0:1790784497.293082:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 155 00000100:00100000:2.0:1790784497.293108:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459349f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+43:11417:x1877773344905344:12345-192.168.206.32@tcp:101:stat.0 00010000:00010000:2.0:1790784497.293139:0:9249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784497.293161:0:9249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d4135 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813520c expref: -99 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.293244:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d413c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.293262:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d413c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.293275:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d413c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.293292:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4143 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.293299:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4143 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.293305:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4143 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.293811:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d414a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.293825:0:9249:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4120 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135205 expref: 44 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.293833:0:9249:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d414a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.293888:0:9249:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4120 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135205 expref: 44 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.293906:0:9249:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4120 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135205 expref: 44 pid: 5820 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784497.293923:0:9249:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d715880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9249:1877773359586944:192.168.206.32@tcp:104: 00000100:00100000:2.0:1790784497.294211:0:9249:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593f57f6c0 going to sleep for 11 seconds 00000100:00080000:3.0:1790784497.294423:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790784497.298974:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784497.299229:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344905600 00000100:00100000:1.0:1790784497.299241:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344905600 00000100:00100000:1.0:1790784497.299308:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 43 00000100:00100000:1.0:1790784497.299320:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d303100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+45:5591:x1877773344905600:12345-192.168.206.32@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790784497.299815:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d303100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+46:5591:x1877773344905600:12345-192.168.206.32@tcp:35:ldlm_bl.0 Request processed in 495us (852us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1790784497.299824:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 43 00000100:00100000:2.0:1790784497.300550:0:9249:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d715880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9249:1877773359586944:192.168.206.32@tcp:104: 00010000:00010000:2.0:1790784497.300588:0:9249:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d414a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784497.303920:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784497.304073:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344905728 00000100:00100000:2.0:1790784497.304087:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344905728 00010000:00010000:2.0:1790784497.304147:0:8421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4120 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135205 expref: 46 pid: 5820 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784497.304285:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 66 00000100:00100000:2.0:1790784497.304297:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f495880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+46:2352:x1877773344905728:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790784497.304315:0:8421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784497.304322:0:8421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4120 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135205 expref: 46 pid: 5820 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.304336:0:8421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4120 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135205 expref: 46 pid: 5820 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.304416:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4120 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135205 expref: 46 pid: 5820 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.304438:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94590345d200) 00010000:00010000:2.0:1790784497.304445:0:8421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d414a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.304455:0:8421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d414a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.304464:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d414a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.304501:0:8421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790784497.304568:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f495880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+45:2352:x1877773344905728:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 273us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784497.304576:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 66 00010000:00010000:1.0:1790784497.305052:0:9249:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d414a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.305063:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d414a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790784497.305125:0:9249:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1790784497.305131:0:9249:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790784497.305161:0:9249:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d414a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.305177:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d414a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.305188:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d413c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.305195:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d413c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.305203:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d413c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.305223:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74200 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784497.305228:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d413c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.305235:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d413c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.305247:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94590345dc00) 00010000:00010000:1.0:1790784497.305250:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784497.305255:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d413c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.305261:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d413c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.305278:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4143 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.305283:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4143 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.305289:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4143 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.305294:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74e00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784497.305297:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4143 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.305303:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4143 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.305324:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff945903af2a00) 00010000:00010000:1.0:1790784497.305327:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784497.305330:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4143 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.305337:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4143 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.305431:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d4135 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813520c expref: 45 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.305449:0:9249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d414a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813520c expref: 44 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.305456:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94590345d200) 00010000:00010000:1.0:1790784497.305458:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790784497.305461:0:9249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe75600, rc 0) 00000100:00100000:1.0:1790784497.305515:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459349f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+44:11417:x1877773344905344:12345-192.168.206.32@tcp:101:stat.0 Request processed in 12409us (13068us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784497.305524:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 155 00000100:00100000:0.0:1790784497.403972:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784497.404086:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344905984 00000100:00100000:1.0:1790784497.404101:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344905984 00000100:00100000:1.0:1790784497.404189:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 156 00000100:00100000:1.0:1790784497.404202:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+44:11423:x1877773344905984:12345-192.168.206.32@tcp:36:truncate.0 00010000:00010000:1.0:1790784497.404277:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784497.404311:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d414a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813520c expref: 44 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.404358:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94590345d200) 00010000:00010000:1.0:1790784497.404365:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790784497.404720:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d4151 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.404736:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d4151 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.404748:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d4151 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790784497.404809:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:1.0:1790784497.404838:0:5819:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000247fa224 reply state 00000000eef5fa32 transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d4151 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784497.404848:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790784497.404984:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+46:11423:x1877773344905984:12345-192.168.206.32@tcp:36:truncate.0 Request processed in 783us (1026us total) trans 4294967445 rc 0/0 00000100:00100000:1.0:1790784497.404993:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 156 00000020:00080000:1.0:1790784497.405000:0:5819:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790784497.412554:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d4151 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.412579:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d4151 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.412587:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d4151 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.412594:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030c00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784497.412641:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d4151 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.412652:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d4151 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.412681:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94590345d200) 00010000:00010000:3.0:1790784497.412685:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784497.412692:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d4151 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.412699:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d4151 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784497.570263:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784497.570503:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344906112 00000100:00100000:1.0:1790784497.570518:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344906112 00000100:00100000:1.0:1790784497.570601:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 157 00000100:00100000:1.0:1790784497.570613:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+45:11437:x1877773344906112:12345-192.168.206.32@tcp:101:stat.0 00010000:00010000:1.0:1790784497.570654:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784497.570861:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4158 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135213 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.570972:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d415f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.571000:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d415f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.571014:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d415f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.571030:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4166 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.571036:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.571044:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.571154:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d416d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.571163:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d416d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.571170:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d416d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790784497.571213:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1790784497.571219:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790784497.571244:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d416d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.571269:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d416d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.571279:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d415f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.571286:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d415f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.571294:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d415f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.571301:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030c00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784497.571306:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d415f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.571315:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d415f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.571827:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94590345dc00) 00010000:00010000:1.0:1790784497.571834:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784497.571843:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d415f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.571851:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d415f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.571874:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.571881:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4166 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.571898:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4166 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.571904:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900031c00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784497.571907:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4166 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.571914:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4166 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.571924:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94590345dd00) 00010000:00010000:1.0:1790784497.571927:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784497.571930:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4166 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.571936:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4166 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.573282:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4158 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135213 expref: 47 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.573321:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d416d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135213 expref: 46 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784497.573807:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94590345d200) 00010000:00010000:1.0:1790784497.573812:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790784497.573817:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945900031800, rc 0) 00000100:00100000:1.0:1790784497.573969:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+46:11437:x1877773344906112:12345-192.168.206.32@tcp:101:stat.0 Request processed in 3355us (3720us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784497.574010:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 157 00000100:00100000:1.0:1790784497.684555:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784497.685135:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344906368 00000100:00100000:3.0:1790784497.685152:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344906368 00000100:00100000:3.0:1790784497.685516:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 158 00000100:00100000:3.0:1790784497.685531:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+46:11447:x1877773344906368:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:3.0:1790784497.685561:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784497.685589:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d4174 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813521a expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790784497.685734:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1790784497.685901:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d4174 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813521a expref: 48 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.685919:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2b00) 00010000:00010000:3.0:1790784497.685923:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790784497.685929:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d4174 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813521a expref: 48 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.685968:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945901524600, rc 0) 00000100:00100000:3.0:1790784497.686117:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+47:11447:x1877773344906368:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 588us (1574us total) trans 4294967446 rc 301/301 00000100:00100000:3.0:1790784497.686125:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 158 00000100:00100000:1.0:1790784497.690200:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784497.690884:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344906624 00000100:00100000:3.0:1790784497.690900:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344906624 00000100:00100000:3.0:1790784497.691161:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 44 00000100:00100000:3.0:1790784497.691175:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc17c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+47:11447:x1877773344906624:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:3.0:1790784497.691591:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc17c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+48:11447:x1877773344906624:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 417us (1404us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1790784497.691600:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 44 00000100:00100000:0.0:1790784497.749822:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784497.750010:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344906880 00000100:00100000:2.0:1790784497.750025:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344906880 00000100:00100000:2.0:1790784497.750106:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 159 00000100:00100000:2.0:1790784497.750119:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+48:11453:x1877773344906880:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:2.0:1790784497.750150:0:9249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784497.750177:0:9249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d4182 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135221 expref: -99 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.750306:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d4189 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.750344:0:9249:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d416d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135213 expref: 49 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.750354:0:9249:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d4189 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.750440:0:9249:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d416d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135213 expref: 49 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.750456:0:9249:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d416d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135213 expref: 49 pid: 5820 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784497.750473:0:9249:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d715880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9249:1877773359587072:192.168.206.32@tcp:104: 00000100:00100000:2.0:1790784497.750585:0:9249:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593f57f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790784497.754976:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784497.755419:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344907008 00000100:00100000:1.0:1790784497.755432:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344907008 00000100:00100000:2.0:1790784497.755461:0:9249:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d715880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9249:1877773359587072:192.168.206.32@tcp:104: 00010000:00010000:1.0:1790784497.755483:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d416d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135213 expref: 50 pid: 5820 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.755492:0:9249:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d4189 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784497.755566:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 67 00000100:00100000:3.0:1790784497.755580:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+50:2352:x1877773344907008:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790784497.755600:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784497.755608:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d416d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135213 expref: 50 pid: 5820 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.755631:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d416d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135213 expref: 50 pid: 5820 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.755669:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d416d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135213 expref: 50 pid: 5820 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.755691:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94590345d200) 00010000:00010000:3.0:1790784497.755717:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d4189 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.755729:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d4189 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.755738:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d4189 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.755768:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790784497.755838:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+49:2352:x1877773344907008:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 262us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784497.755846:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 67 00010000:00010000:2.0:1790784497.756124:0:9249:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d4189 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.756133:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d4189 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784497.756158:0:9249:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1790784497.756662:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d4182 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135221 expref: 50 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.756702:0:9249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d4189 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135221 expref: 49 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.756710:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94590345d200) 00010000:00010000:2.0:1790784497.756713:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790784497.756716:0:9249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74000, rc 0) 00000100:00100000:2.0:1790784497.756823:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+49:11453:x1877773344906880:12345-192.168.206.32@tcp:101:bash.0 Request processed in 6706us (7015us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1790784497.756832:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 159 00000100:00100000:0.0:1790784497.761747:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784497.761928:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344907264 00000100:00100000:2.0:1790784497.761942:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344907264 00000100:00100000:2.0:1790784497.762125:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 160 00000100:00100000:2.0:1790784497.762137:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+49:11453:x1877773344907264:12345-192.168.206.32@tcp:36:bash.0 00010000:00010000:2.0:1790784497.762513:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4197 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.762533:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4197 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.762546:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4197 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790784497.762610:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:2.0:1790784497.762651:0:5818:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006de1ae01 reply state 000000002fe09ecb transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4197 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784497.762673:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790784497.762870:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+52:11453:x1877773344907264:12345-192.168.206.32@tcp:36:bash.0 Request processed in 734us (1135us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1790784497.762878:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 160 00000020:00080000:2.0:1790784497.762884:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790784497.769208:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00010000:00010000:2.0:1790784497.770084:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4197 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.770103:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4197 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.770112:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4197 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.770119:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74e00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784497.770124:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4197 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.770133:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4197 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.770155:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94590345d200) 00010000:00010000:2.0:1790784497.770159:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784497.770165:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4197 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.770250:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4197 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784497.770363:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344907392 00000100:00100000:3.0:1790784497.770491:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344907392 00000100:00100000:3.0:1790784497.770567:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 161 00000100:00100000:3.0:1790784497.770579:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+51:11453:x1877773344907392:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:3.0:1790784497.770609:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784497.770639:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d419e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135228 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.770750:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d41a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.770765:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d4189 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135221 expref: 52 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.770774:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d41a5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.770835:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d4189 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135221 expref: 52 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.770851:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d4189 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135221 expref: 52 pid: 9249 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784497.771072:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d303100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5820:1877773359587200:192.168.206.32@tcp:104: 00000100:00100000:3.0:1790784497.771350:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459051ad9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790784497.774786:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784497.774935:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344907520 00000100:00100000:2.0:1790784497.774947:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344907520 00010000:00010000:2.0:1790784497.775011:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d4189 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135221 expref: 53 pid: 9249 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784497.775091:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 68 00000100:00100000:2.0:1790784497.775103:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+53:2352:x1877773344907520:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790784497.775123:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784497.775131:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d4189 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135221 expref: 53 pid: 9249 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.775145:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d4189 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135221 expref: 53 pid: 9249 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.775184:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94590345d200) 00010000:00010000:2.0:1790784497.775190:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d41a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.775201:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d41a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.775208:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d41a5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.775230:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790784497.775291:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+53:2352:x1877773344907520:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 190us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784497.775298:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 68 00010000:00010000:3.0:1790784497.776476:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d4189 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135221 expref: 52 pid: 9249 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784497.776502:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d303100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5820:1877773359587200:192.168.206.32@tcp:104: 00010000:00010000:3.0:1790784497.776530:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d41a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.776540:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d41a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.776546:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d41a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790784497.776606:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1790784497.776612:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790784497.776648:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d41a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.776795:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d419e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135228 expref: 52 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.776834:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d41a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135228 expref: 51 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.776843:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94590345d200) 00010000:00010000:3.0:1790784497.776846:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790784497.776849:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945901525e00, rc 0) 00000100:00100000:3.0:1790784497.778651:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+51:11453:x1877773344907392:12345-192.168.206.32@tcp:101:bash.0 Request processed in 8061us (9443us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784497.781835:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 161 00000100:00100000:1.0:1790784497.782111:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784497.782212:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344907776 00000100:00100000:2.0:1790784497.782225:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344907776 00000100:00100000:2.0:1790784497.782286:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 45 00000100:00100000:2.0:1790784497.782297:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+51:11453:x1877773344907776:12345-192.168.206.32@tcp:35:bash.0 00000100:00100000:2.0:1790784497.782796:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+52:11453:x1877773344907776:12345-192.168.206.32@tcp:35:bash.0 Request processed in 498us (683us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1790784497.782804:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 45 00000040:00080000:0.0:1790784497.850763:0:11656:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790784497.850775:0:11656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790784497.851149:0:11656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1790784497.851158:0:11656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790784497.862329:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784497.862745:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344908032 00000100:00100000:0.0:1790784497.862760:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344908032 00000100:00100000:0.0:1790784497.862840:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 162 00000100:00100000:0.0:1790784497.862883:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d303100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+52:11463:x1877773344908032:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:0.0:1790784497.862920:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784497.862947:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d41ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813522f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790784497.863067:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1790784497.863222:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d41ac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813522f expref: 54 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784497.863239:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2b00) 00010000:00010000:0.0:1790784497.863242:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790784497.863249:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d41ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813522f expref: 54 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784497.863266:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b0600, rc 0) 00000100:00100000:0.0:1790784497.863345:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d303100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+53:11463:x1877773344908032:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 466us (1031us total) trans 4294967452 rc 301/301 00000100:00100000:0.0:1790784497.863353:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 162 00000100:00100000:1.0:1790784497.866941:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784497.867050:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344908160 00000100:00100000:2.0:1790784497.867063:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344908160 00000100:00100000:2.0:1790784497.867143:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 163 00000100:00100000:2.0:1790784497.867155:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592dac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+53:11463:x1877773344908160:12345-192.168.206.32@tcp:34:lfs.0 00010000:00010000:2.0:1790784497.867316:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d41ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.867336:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d41ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.867353:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d41ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.867369:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d41c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.867423:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d41c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.867431:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d41c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.867549:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d41c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.867559:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d41c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.867595:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d41c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790784497.867658:0:9249:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d41c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.867674:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d41ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.867681:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d41ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.867689:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d41ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.867700:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74e00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784497.867707:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d41ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.867716:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d41ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.867730:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94590345dc00) 00010000:00010000:2.0:1790784497.867733:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784497.867738:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d41ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.867745:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d41ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.867760:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d41c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.867771:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d41c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.867777:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d41c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.867781:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75600 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784497.867783:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d41c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.867789:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d41c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.867794:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff945903af2e00) 00010000:00010000:2.0:1790784497.867797:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784497.867799:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d41c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.867805:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d41c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.867819:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d41c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.867823:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d41c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.867828:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d41c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.867833:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74200 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784497.867839:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d41c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.867844:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d41c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.867850:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94590345d200) 00010000:00010000:2.0:1790784497.867852:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784497.867855:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d41c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.867859:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d41c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784497.867947:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592dac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+53:11463:x1877773344908160:12345-192.168.206.32@tcp:34:lfs.0 Request processed in 793us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784497.867955:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 163 00000100:00100000:1.0:1790784497.870574:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784497.870811:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344908416 00000100:00100000:2.0:1790784497.870824:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344908416 00000100:00100000:2.0:1790784497.870932:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 46 00000100:00100000:2.0:1790784497.870944:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592dac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+53:11463:x1877773344908416:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:2.0:1790784497.871240:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592dac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+54:11463:x1877773344908416:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 298us (677us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1790784497.871248:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 46 00000100:00100000:0.0:1790784497.911769:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784497.911949:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344908672 00000100:00100000:3.0:1790784497.911962:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344908672 00000100:00100000:3.0:1790784497.912040:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 164 00000100:00100000:3.0:1790784497.912052:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+54:11466:x1877773344908672:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:3.0:1790784497.912087:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784497.912114:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d41cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135236 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.912225:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d41d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.912243:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d41d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.912257:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d41d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.912296:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d41dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.912304:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d41dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.912310:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d41dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.912526:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d41e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.912537:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d41e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.912544:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d41e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790784497.912554:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1790784497.912702:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d41d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.912711:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d41d6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.912718:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d41d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.912724:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901524000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784497.912729:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d41d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.912749:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d41d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.912764:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94590345dc00) 00010000:00010000:3.0:1790784497.912767:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784497.912774:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d41d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.912781:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d41d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.912799:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d41dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.912805:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d41dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.912811:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d41dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.912817:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901525a00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784497.912820:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d41dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.912826:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d41dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.912833:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94592012aa00) 00010000:00010000:3.0:1790784497.912835:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784497.912838:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d41dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.912868:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d41dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.912928:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d41cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135236 expref: 57 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.912945:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d41e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135236 expref: 56 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.912954:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94590345d200) 00010000:00010000:3.0:1790784497.912956:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790784497.912959:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945901524800, rc 0) 00000100:00100000:3.0:1790784497.913436:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+56:11466:x1877773344908672:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 1382us (1678us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1790784497.913447:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 164 00000100:00100000:1.0:1790784497.917920:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784497.918015:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784497.918098:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344908928 00000100:00100000:3.0:1790784497.918110:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344908928 00000100:00100000:3.0:1790784497.918200:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 12 00000100:00100000:3.0:1790784497.918211:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592dac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+56:2351:x1877773344908928:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790784497.918229:0:8421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784497.918262:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d41e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135236 expref: 56 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784497.918284:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94590345d200) 00010000:00010000:3.0:1790784497.918291:0:8421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790784497.918362:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592dac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+55:2351:x1877773344908928:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 153us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784497.918413:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 12 00000100:00100000:2.0:1790784497.919805:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344908800 00000100:00100000:2.0:1790784497.919822:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344908800 00000100:00100000:2.0:1790784497.919890:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 165 00000100:00100000:2.0:1790784497.919901:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592dac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+55:11466:x1877773344908800:12345-192.168.206.32@tcp:54:lfs.0 00010000:00010000:2.0:1790784497.919988:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d41f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.920025:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d41f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.920039:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d41f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.920076:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d41f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.920084:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d41f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.920092:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d41f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.920099:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74200 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784497.920104:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d41f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.920113:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d41f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.920126:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94590345d200) 00010000:00010000:2.0:1790784497.920130:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790784497.920135:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d41f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784497.920142:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d41f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784497.920658:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592dac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+55:11466:x1877773344908800:12345-192.168.206.32@tcp:54:lfs.0 Request processed in 755us (2747us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784497.920676:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 165 00000100:00100000:1.0:1790784497.923281:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784497.923362:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344909184 00000100:00100000:3.0:1790784497.923736:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344909184 00000100:00100000:3.0:1790784497.923839:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 47 00000100:00100000:3.0:1790784497.923851:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+55:11466:x1877773344909184:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:3.0:1790784497.924312:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+56:11466:x1877773344909184:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 462us (1044us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1790784497.924322:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 47 00000100:00100000:1.0:1790784498.067156:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784498.067749:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344909440 00000100:00100000:2.0:1790784498.067763:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344909440 00000100:00100000:2.0:1790784498.067844:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 166 00000100:00100000:2.0:1790784498.067856:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+56:11484:x1877773344909440:12345-192.168.206.32@tcp:101:cat.0 00010000:00010000:2.0:1790784498.067889:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784498.067916:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d41f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813523d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784498.068070:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d4200 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784498.068089:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d4200 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784498.068104:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d4200 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784498.068118:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1790784498.068570:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d41f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813523d expref: 59 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784498.068594:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d4200 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813523d expref: 58 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784498.068604:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94590345d200) 00010000:00010000:2.0:1790784498.068607:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790784498.068611:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe75600, rc 0) 00000100:00100000:2.0:1790784498.068725:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+58:11484:x1877773344909440:12345-192.168.206.32@tcp:101:cat.0 Request processed in 872us (1583us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1790784498.068734:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 166 00000100:00100000:0.0:1790784498.094638:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784498.094972:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344909568 00000100:00100000:2.0:1790784498.094985:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344909568 00000100:00100000:2.0:1790784498.095056:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 167 00000100:00100000:2.0:1790784498.095069:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+58:11485:x1877773344909568:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:2.0:1790784498.095100:0:9249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784498.095126:0:9249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d420e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135244 expref: -99 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784498.095208:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4215 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784498.095224:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4215 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784498.095237:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4215 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784498.095279:0:9249:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1790784498.095283:0:9249:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790784498.095304:0:9249:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4215 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784498.095333:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d420e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135244 expref: 60 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784498.095358:0:9249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4215 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135244 expref: 59 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784498.095458:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94590345dc00) 00010000:00010000:2.0:1790784498.095462:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790784498.095466:0:9249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74e00, rc 0) 00000100:00100000:2.0:1790784498.095536:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+59:11485:x1877773344909568:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 470us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784498.095543:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 167 00000100:00100000:1.0:1790784498.103332:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784498.103485:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344909952 00000100:00100000:2.0:1790784498.103497:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344909952 00000100:00100000:2.0:1790784498.103559:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 48 00000100:00100000:2.0:1790784498.103570:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+59:11485:x1877773344909952:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:2.0:1790784498.104200:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+60:11485:x1877773344909952:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 629us (889us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1790784498.104210:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 48 00000004:00080000:1.0:1790784498.107295:0:6776:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 332256915739ns, next at 333256912461ns, rc = 0 00000100:00100000:2.0:1790784498.107404:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790784498.107431:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359587328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790784498.107515:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784498.108806:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359587328 00000100:00100000:1.0:1790784498.108823:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359587328 00000100:00100000:1.0:1790784498.108926:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790784498.108940:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1877773359587328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790784498.108986:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790784498.109086:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1877773359587328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 151us (1570us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784498.109094:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790784498.109183:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359587328:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790784498.109323:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790784498.110363:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784498.110464:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344910080 00000100:00100000:3.0:1790784498.110474:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344910080 00000100:00100000:3.0:1790784498.110538:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 13 00000100:00100000:3.0:1790784498.110549:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+60:11485:x1877773344910080:12345-192.168.206.32@tcp:103:lfs.0 00010000:00010000:3.0:1790784498.110567:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790784498.110598:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d41a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135228 expref: 60 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.110636:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d4200 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813523d expref: 59 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.110652:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d40b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351e9 expref: 58 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.110674:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94590345d200) 00010000:00010000:3.0:1790784498.110688:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790784498.110937:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+57:11485:x1877773344910080:12345-192.168.206.32@tcp:103:lfs.0 Request processed in 388us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784498.110963:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 13 00000100:00100000:3.0:1790784498.111224:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790784498.112549:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1877773359587584:0@lo:400:kworker.0 00000100:00100000:3.0:1790784498.112639:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784498.112691:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3280:1877773359587456:0@lo:400:kworker.0 00000100:00100000:3.0:1790784498.112724:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784498.112819:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359587456 00000100:00100000:3.0:1790784498.112828:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359587456 00000100:00100000:0.0:1790784498.113007:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359587584 00000100:00100000:0.0:1790784498.113011:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359587584 00000100:00100000:3.0:1790784498.113196:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1790784498.113207:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903696c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3280:x1877773359587456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784498.113269:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903696c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3280:x1877773359587456:12345-0@lo:400:kworker.0 Request processed in 64us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784498.113277:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1790784498.113334:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3280:1877773359587456:0@lo:400:kworker.0 00000100:00100000:3.0:1790784498.113351:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790784498.113360:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359587968:0@lo:400:kworker.0 00000100:00100000:3.0:1790784498.113420:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784498.113451:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1877773359587840:0@lo:400:kworker.0 00000100:00100000:3.0:1790784498.113480:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784498.113501:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790784498.113507:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3282:1877773359587712:0@lo:400:kworker.0 00000100:00100000:3.0:1790784498.113530:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784498.113557:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359587968 00000100:00100000:3.0:1790784498.113562:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359587968 00000100:00100000:3.0:1790784498.113604:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790784498.113643:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d300700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359587968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784498.113696:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d300700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359587968:12345-0@lo:400:kworker.0 Request processed in 54us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784498.113702:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790784498.113732:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359587968:0@lo:400:kworker.0 00000100:00080000:3.0:1790784498.113751:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790784498.115246:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359587840 00000100:00100000:0.0:1790784498.115261:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359587840 00000100:00080000:0.0:1790784498.115294:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790784498.115317:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359587712 00000100:00100000:0.0:1790784498.115321:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359587712 00000100:00080000:0.0:1790784498.115338:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790784498.115357:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1790784498.115406:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d301c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1877773359587584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784498.115510:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d301c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1877773359587584:12345-0@lo:400:kworker.0 Request processed in 108us (2869us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784498.115518:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1790784498.115566:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3280:1877773359587584:0@lo:400:kworker.0 00000100:00100000:0.0:1790784498.115591:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1790784498.115597:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d301880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1877773359587840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784498.115780:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d301880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1877773359587840:12345-0@lo:400:kworker.0 Request processed in 182us (2298us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784498.115787:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1790784498.115799:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790784498.115805:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1877773359587712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784498.115835:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1877773359587712:12345-0@lo:400:kworker.0 Request processed in 32us (2305us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784498.115841:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790784498.115954:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3282:1877773359587712:0@lo:400:kworker.0 00000100:00100000:0.0:1790784498.115967:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1877773359587840:0@lo:400:kworker.0 00000100:00100000:0.0:1790784498.117239:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784498.117416:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344910208 00000100:00100000:3.0:1790784498.117426:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344910208 00000100:00100000:3.0:1790784498.117484:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 168 00000100:00100000:3.0:1790784498.117494:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+57:11485:x1877773344910208:12345-192.168.206.32@tcp:58:lfs.0 00010000:00010000:3.0:1790784498.117674:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d421c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.117695:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d421c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.117710:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d421c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790784498.118714:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1790784498.118843:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+57:11485:x1877773344910208:12345-192.168.206.32@tcp:58:lfs.0 Request processed in 1347us (1609us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784498.118979:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 168 00000100:00100000:0.0:1790784498.149564:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784498.150030:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344910336 00000100:00100000:3.0:1790784498.150044:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344910336 00000100:00100000:3.0:1790784498.150123:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 169 00000100:00100000:3.0:1790784498.150136:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+57:11487:x1877773344910336:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:3.0:1790784498.150165:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784498.150223:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d4223 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813524b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.150312:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d422a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.150330:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d422a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.150345:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d422a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.150361:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d4231 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.150367:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d4231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.150427:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d4231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.150540:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d4238 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.150550:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d4238 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.150557:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d4238 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790784498.150612:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1790784498.150627:0:5818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790784498.150651:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d4238 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.151330:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d4238 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.151342:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d422a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.151349:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d422a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.151356:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d422a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.151362:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901524600 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784498.151367:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d422a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.151409:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d422a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.151425:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94590345dc00) 00010000:00010000:3.0:1790784498.151428:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784498.151433:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d422a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.151440:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d422a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.151455:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d4231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.151461:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d4231 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.151473:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d4231 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.151478:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901525a00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784498.151481:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d4231 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.151486:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d4231 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.151493:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94592012a900) 00010000:00010000:3.0:1790784498.151495:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784498.151498:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d4231 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.151503:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d4231 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.151553:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d4223 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813524b expref: 59 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.151568:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d4238 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813524b expref: 58 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.151576:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94592012aa00) 00010000:00010000:3.0:1790784498.151578:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790784498.151581:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945901524000, rc 0) 00000100:00100000:3.0:1790784498.151864:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+58:11487:x1877773344910336:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 1730us (2313us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784498.151886:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 169 00010000:00010000:1.0:1790784498.171255:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784498.632434:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359588096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790784498.632535:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784498.632725:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359588096 00000100:00100000:1.0:1790784498.632735:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359588096 00000100:00100000:1.0:1790784498.632800:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790784498.632813:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d301180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359588096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790784498.632860:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790784498.640937:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d301180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359588096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8111us (8387us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784498.640957:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790784498.650163:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359588096:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1790784498.874771:0:11656:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790784498.874779:0:11656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790784498.874835:0:11656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1790784498.874842:0:11656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790784498.875032:0:11656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d223800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11656:1877773359588224:192.168.206.32@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790784498.877501:0:11656:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459050c0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790784498.887005:0:11656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d223800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11656:1877773359588224:192.168.206.32@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790784498.887369:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784498.887440:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344910464 00000100:00100000:1.0:1790784498.887447:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344910464 00000100:00100000:1.0:1790784498.887520:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 170 00000100:00100000:1.0:1790784498.887531:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+58:11498:x1877773344910464:12345-192.168.206.32@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790784498.887567:0:5820:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790784498.887717:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+58:11498:x1877773344910464:12345-192.168.206.32@tcp:53:lhsmtool_posix.0 Request processed in 187us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784498.887726:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 170 00000100:00100000:1.0:1790784498.903861:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784498.911676:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344910592 00000100:00100000:3.0:1790784498.911692:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344910592 00000100:00100000:3.0:1790784498.911748:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 171 00000100:00100000:3.0:1790784498.911759:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+58:11498:x1877773344910592:12345-192.168.206.32@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1790784498.911825:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d423f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.911841:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d423f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.911854:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d423f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.911869:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d4246 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.911876:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d4246 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.911883:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d4246 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.911907:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d424d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.911926:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d424d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.911932:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d424d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790784498.912566:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1790784498.912572:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790784498.912585:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d424d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.912597:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d423f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.912605:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d423f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.912612:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d423f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.912629:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901525e00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784498.912633:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d423f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.912641:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d423f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.912654:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94592012a400) 00010000:00010000:3.0:1790784498.912658:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784498.912663:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d423f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.912681:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d423f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.912695:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d4246 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.912701:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d4246 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.912706:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d4246 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.912711:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901525a00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784498.912714:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d4246 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.912720:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d4246 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.912728:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff94592012a900) 00010000:00010000:3.0:1790784498.912730:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784498.912733:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d4246 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.912739:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d4246 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.912754:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d424d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.912761:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d424d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.912774:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d424d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.912779:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901524600 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784498.912783:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d424d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.912789:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d424d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.912798:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94592012aa00) 00010000:00010000:3.0:1790784498.912800:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784498.912803:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d424d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.912810:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d424d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784498.912884:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+58:11498:x1877773344910592:12345-192.168.206.32@tcp:34:lhsmtool_posix.0 Request processed in 1126us (9031us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784498.912893:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 171 00000100:00100000:0.0:1790784498.920350:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784498.920558:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344910848 00000100:00100000:2.0:1790784498.920567:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344910848 00000100:00100000:2.0:1790784498.920624:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 172 00000100:00100000:2.0:1790784498.920634:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+58:11498:x1877773344910848:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790784498.920653:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784498.920673:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d4254 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135252 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784498.920781:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d425b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784498.920797:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d425b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784498.920808:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d425b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784498.920819:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1790784498.920906:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d425b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784498.920914:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d425b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784498.920920:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d425b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784498.920926:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784498.920930:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d425b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784498.920937:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d425b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784498.920948:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94592012aa00) 00010000:00010000:2.0:1790784498.920961:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790784498.920967:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d425b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784498.920983:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d425b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784498.921022:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d4254 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135252 expref: 60 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784498.921032:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94592012a400) 00010000:00010000:2.0:1790784498.921034:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790784498.921038:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d4254 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135252 expref: 60 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784498.921046:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe75200, rc 0) 00000100:00100000:2.0:1790784498.921105:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+59:11498:x1877773344910848:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 473us (764us total) trans 4294967458 rc 301/301 00000100:00100000:2.0:1790784498.921113:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 172 00000100:00100000:0.0:1790784498.924755:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784498.937160:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344910976 00000100:00100000:3.0:1790784498.937176:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344910976 00000100:00100000:2.0:1790784498.937632:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 173 00000100:00100000:2.0:1790784498.937643:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+59:11498:x1877773344910976:12345-192.168.206.32@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790784498.937677:0:5819:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790784498.937788:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+59:11498:x1877773344910976:12345-192.168.206.32@tcp:53:lhsmtool_posix.0 Request processed in 147us (13042us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784498.937796:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 173 00000100:00100000:3.0:1790784498.943297:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784498.943982:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344911232 00000100:00100000:2.0:1790784498.943991:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344911232 00000100:00100000:2.0:1790784498.944044:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 174 00000100:00100000:2.0:1790784498.944055:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d300a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+59:11498:x1877773344911232:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790784498.944085:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784498.944088:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790784498.944115:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4215 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135244 expref: 59 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784498.944133:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94590345dc00) 00010000:00010000:2.0:1790784498.944138:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790784498.944152:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4269 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135259 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790784498.945062:0:5820:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1790784498.945313:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d4270 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784498.945327:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d4270 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784498.945338:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d4270 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784498.950942:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4269 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135259 expref: 61 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784498.950970:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d4270 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135259 expref: 60 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784498.950980:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff945903af2e00) 00010000:00010000:2.0:1790784498.950984:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790784498.950994:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe75400, rc 0) 00000100:00100000:2.0:1790784498.951053:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d300a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+60:11498:x1877773344911232:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 6999us (7762us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1790784498.951061:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 174 00000100:00100000:0.0:1790784498.963063:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784498.963171:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344911488 00000100:00100000:1.0:1790784498.963180:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344911488 00000100:00100000:1.0:1790784498.963236:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 175 00000100:00100000:1.0:1790784498.963246:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+60:11498:x1877773344911488:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790784498.963427:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784498.963577:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d4270 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135259 expref: 60 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784498.963595:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff945903af2e00) 00010000:00010000:1.0:1790784498.963628:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790784498.963650:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d427e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784498.963664:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d427e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784498.963744:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d427e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784498.963763:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4285 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xd77e4130 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784498.963772:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4285 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd77e4130 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784498.963779:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4285 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd77e4130 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784498.963836:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d427e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784498.963845:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d427e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784498.963852:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d427e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784498.963859:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784498.963869:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d427e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784498.963878:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d427e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784498.963887:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94590345dc00) 00010000:00010000:1.0:1790784498.963890:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784498.963894:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d427e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784498.963901:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d427e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784498.963912:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4285 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd77e4130 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784498.963919:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4285 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd77e4130 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784498.963924:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4285 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd77e4130 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784498.963929:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900031800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784498.963932:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4285 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd77e4130 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784498.963937:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4285 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd77e4130 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784498.963968:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xd77e4130 (ffff94590345dd00) 00010000:00010000:1.0:1790784498.963970:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784498.963978:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4285 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd77e4130 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784498.963984:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4285 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd77e4130 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784498.964064:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+59:11498:x1877773344911488:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 Request processed in 819us (1008us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790784498.964072:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 175 00000100:00100000:2.0:1790784498.968666:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784498.971156:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344911616 00000100:00100000:3.0:1790784498.971170:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344911616 00000100:00100000:3.0:1790784498.971236:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 176 00000100:00100000:3.0:1790784498.971246:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+59:11498:x1877773344911616:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790784498.971265:0:9249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784498.971295:0:9249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d428c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135260 expref: -99 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.971327:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d4293 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.971340:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d4293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.971352:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d4293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.971467:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d428c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135260 expref: 61 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.971486:0:9249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d4293 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135260 expref: 60 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.971495:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94592012a900) 00010000:00010000:3.0:1790784498.971498:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790784498.971501:0:9249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945901525a00, rc 0) 00000100:00100000:3.0:1790784498.971570:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+60:11498:x1877773344911616:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 325us (2913us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784498.971577:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 176 00000100:00100000:0.0:1790784498.978221:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784498.981151:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344911872 00000100:00100000:3.0:1790784498.981166:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344911872 00000100:00100000:3.0:1790784498.981275:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 177 00000100:00100000:3.0:1790784498.981287:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+60:11498:x1877773344911872:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790784498.981368:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d429a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.981418:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d429a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.981432:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d429a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790784498.981724:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1790784498.981735:0:5818:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 333131359494ns, next at 334131357134ns, rc = 0 00000004:00010000:3.0:1790784498.981813:0:5818:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005cc48c0d reply state 000000008445a7d1 transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d429a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784498.981823:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790784498.981927:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+62:11498:x1877773344911872:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 Request processed in 641us (3713us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1790784498.981934:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 177 00000100:00100000:1.0:1790784498.988391:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00010000:00010000:3.0:1790784498.988507:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d429a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.988520:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d429a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.988529:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d429a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.988535:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901524600 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784498.988540:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d429a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.988548:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d429a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.988580:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94592012a900) 00010000:00010000:3.0:1790784498.988583:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790784498.988588:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d429a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784498.988595:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d429a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784498.989366:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344912000 00000100:00100000:0.0:1790784498.989397:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344912000 00000100:00100000:0.0:1790784498.989500:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 178 00000100:00100000:0.0:1790784498.989510:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945934a15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+61:11498:x1877773344912000:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790784498.989543:0:9249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784498.989559:0:9249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d42a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135267 expref: -99 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784498.989612:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d42a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135267 expref: 62 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784498.989637:0:9249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d42a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135267 expref: 62 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784498.989655:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94592012a900) 00010000:00010000:0.0:1790784498.989658:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790784498.989661:0:9249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b1c00, rc 0) 00000100:00100000:0.0:1790784498.989725:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945934a15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+62:11498:x1877773344912000:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 217us (1359us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784498.989731:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 178 00000100:00100000:1.0:1790784498.998550:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784498.998621:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344912128 00000100:00100000:3.0:1790784498.998631:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344912128 00000100:00100000:3.0:1790784498.998825:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 50 00000100:00100000:3.0:1790784498.998837:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945934a14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2351:x1877773344912128:12345-192.168.206.32@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1790784498.998869:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790784498.999341:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945934a14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2351:x1877773344912128:12345-192.168.206.32@tcp:2:lhsmtool_posix.0 Request processed in 505us (807us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1790784498.999350:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 50 00000100:00100000:3.0:1790784499.013795:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784499.014363:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344912384 00000100:00100000:1.0:1790784499.014391:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344912384 00000100:00100000:1.0:1790784499.014452:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 49 00000100:00100000:1.0:1790784499.014463:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+62:11498:x1877773344912384:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790784499.016004:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+63:11498:x1877773344912384:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 Request processed in 1535us (2210us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1790784499.016016:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 49 00000100:00080000:3.0:1790784499.016507:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790784499.023758:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784499.023891:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344912640 00000100:00100000:0.0:1790784499.023901:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344912640 00000100:00100000:0.0:1790784499.023961:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 179 00000100:00100000:0.0:1790784499.023972:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945934a15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+63:11498:x1877773344912640:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790784499.024089:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945934a15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+63:11498:x1877773344912640:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 Request processed in 118us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784499.024098:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 179 00000100:00100000:2.0:1790784499.027951:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784499.028018:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344912768 00000100:00100000:3.0:1790784499.028028:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344912768 00000100:00100000:3.0:1790784499.028090:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 180 00000100:00100000:3.0:1790784499.028100:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+63:11498:x1877773344912768:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790784499.028119:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784499.028138:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d42a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813526e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784499.028216:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d42af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784499.028238:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d42af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784499.028249:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d42af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790784499.028282:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790784499.028299:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d42af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784499.028325:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525e00/0x2c3a1e2a079d42a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813526e expref: 65 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784499.028342:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d42af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813526e expref: 64 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784499.028351:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94592012a900) 00010000:00010000:3.0:1790784499.028354:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790784499.028357:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945901524600, rc 0) 00000100:00100000:3.0:1790784499.028878:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+64:11498:x1877773344912768:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 777us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784499.028886:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 180 00000100:00100000:0.0:1790784499.036721:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784499.037126:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344912896 00000100:00100000:3.0:1790784499.037136:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344912896 00000100:00100000:3.0:1790784499.037195:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 51 00000100:00100000:3.0:1790784499.037206:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fbbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2351:x1877773344912896:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790784499.037222:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784499.037259:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000baa7bc2b/0x2c3a1e2a079d42b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135275 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790784499.037285:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abd33f2, blocks: 0x1 00010000:00010000:3.0:1790784499.037303:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=333s v=(0 0) 00010000:00010000:3.0:1790784499.037308:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784499.037318:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baa7bc2b/0x2c3a1e2a079d42b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135275 expref: 8 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784499.037338:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000baa7bc2b/0x2c3a1e2a079d42b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135275 expref: 8 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784499.037353:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945802d2e800, rc 0) 00000100:00100000:3.0:1790784499.037434:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fbbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:2351:x1877773344912896:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 229us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784499.037443:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 51 00000100:00100000:3.0:1790784499.051927:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784499.051965:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344913152 00000100:00100000:0.0:1790784499.051974:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344913152 00000100:00100000:0.0:1790784499.052027:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 181 00000100:00100000:0.0:1790784499.052039:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+64:11498:x1877773344913152:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790784499.052149:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+64:11498:x1877773344913152:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 Request processed in 112us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784499.052161:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 181 00000100:00100000:3.0:1790784499.055959:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784499.056080:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344913280 00000100:00100000:1.0:1790784499.056089:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344913280 00000100:00100000:1.0:1790784499.056151:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 52 00000100:00100000:1.0:1790784499.056162:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d302d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:11498:x1877773344913280:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790784499.056179:0:6668:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784499.056197:0:6668:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d42bd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813527c expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.056229:0:6668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000baa7bc2b/0x2c3a1e2a079d42b6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135275 expref: 9 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.056246:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784499.056251:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784499.056258:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d42bd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813527c expref: 9 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.056594:0:6668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000baa7bc2b/0x2c3a1e2a079d42b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135275 expref: 9 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.056609:0:6668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000baa7bc2b/0x2c3a1e2a079d42b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135275 expref: 9 pid: 6670 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784499.056638:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945934a17b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6668:1877773359588352:192.168.206.32@tcp:104: 00000100:00100000:1.0:1790784499.056731:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff945904fd79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790784499.061744:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945934a17b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6668:1877773359588352:192.168.206.32@tcp:104: 00010000:00010000:1.0:1790784499.061779:0:6668:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d42bd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.32@tcp remote: 0x394e0d883813527c expref: 9 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.061799:0:6668:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945900031800, rc 0) 00000100:00100000:1.0:1790784499.062013:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d302d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+9:11498:x1877773344913280:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 5851us (6061us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784499.063207:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 52 00000100:00100000:2.0:1790784499.078149:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784499.078427:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344913408 00000100:00100000:3.0:1790784499.078438:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344913408 00010000:00010000:3.0:1790784499.078484:0:8480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000baa7bc2b/0x2c3a1e2a079d42b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135275 expref: 9 pid: 6670 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784499.078524:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 69 00000100:00100000:3.0:1790784499.078534:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905107450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b0f9e8c2-ddb0-4027-babe-0b166585860c+9:2352:x1877773344913408:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790784499.078549:0:8480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784499.078590:0:8480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000baa7bc2b/0x2c3a1e2a079d42b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135275 expref: 9 pid: 6670 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784499.078604:0:8480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000baa7bc2b/0x2c3a1e2a079d42b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135275 expref: 9 pid: 6670 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784499.078634:0:8480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baa7bc2b/0x2c3a1e2a079d42b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135275 expref: 9 pid: 6670 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784499.078650:0:8480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784499.078654:0:8480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784499.078663:0:8480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d42bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.32@tcp remote: 0x394e0d883813527c expref: 8 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784499.078673:0:8480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d42bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.32@tcp remote: 0x394e0d883813527c expref: 8 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784499.078711:0:8480:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d42bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.32@tcp remote: 0x394e0d883813527c expref: 8 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784499.078725:0:8480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d302300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8480:1877773359588480:192.168.206.32@tcp:105: 00000100:00100000:3.0:1790784499.078801:0:8480:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459051ad300 going to sleep for 11 seconds 00000040:00080000:1.0:1790784499.081472:0:12425:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790784499.081481:0:12425:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790784499.081539:0:12425:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1790784499.081552:0:12425:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790784499.081822:0:8480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d302300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8480:1877773359588480:192.168.206.32@tcp:105: 00010000:00010000:2.0:1790784499.081844:0:8480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790784499.081899:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905107450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:2352:x1877773344913408:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 3366us (3758us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784499.081910:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 69 00000100:00100000:0.0:1790784499.084020:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784499.084135:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344913536 00000100:00100000:2.0:1790784499.084143:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344913536 00002000:00100000:2.0:1790784499.084184:0:6674:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff94593fbb8e00 x1877773344913536/t0(0) o4->b0f9e8c2-ddb0-4027-babe-0b166585860c@192.168.206.32@tcp:10/0 lens 504/0 e 0 to 0 dl 1790784510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790784499.084195:0:6674:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94593fbb8e00 with x1877773344913536 ext(0->8) 00002000:00010000:2.0:1790784499.084200:0:6674:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94593fbb8e00 00000100:00100000:2.0:1790784499.084259:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 4 00000100:00100000:2.0:1790784499.084269:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fbb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:2352:x1877773344913536:12345-192.168.206.32@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1790784499.084885:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fbb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+10:2352:x1877773344913536:12345-192.168.206.32@tcp:4:lhsmtool_posix.0 Request processed in 615us (869us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1790784499.084894:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 4 00002000:00100000:2.0:1790784499.084902:0:6674:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff94593fbb8e00 x1877773344913536/t4294967314(0) o4->b0f9e8c2-ddb0-4027-babe-0b166585860c@192.168.206.32@tcp:10/0 lens 504/448 e 0 to 0 dl 1790784510 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790784499.084923:0:6674:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94593fbb8e00 with x1877773344913536 ext(0->8) 00002000:00010000:2.0:1790784499.084926:0:6674:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94593fbb8e00 00000100:00100000:2.0:1790784499.097352:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784499.097487:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344913664 00000100:00100000:3.0:1790784499.097496:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344913664 00000100:00100000:3.0:1790784499.097548:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 182 00000100:00100000:3.0:1790784499.097559:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+64:11498:x1877773344913664:12345-192.168.206.32@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1790784499.135159:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967452 is committed 00000001:00080000:2.0:1790784499.135183:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:2.0:1790784499.135190:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:2.0:1790784499.135214:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1790784499.135223:0:5841:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945904fd7300 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1790784499.135228:0:5841:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9459200f5f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945904fd7900 00000020:00080000:2.0:1790784499.135231:0:5841:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9459200f5200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94593fad8400 00000004:00080000:2.0:1790784499.135285:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:2.0:1790784499.135431:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:1.0:1790784499.135780:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359588608:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790784499.135844:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784499.135902:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359588608 00000100:00100000:1.0:1790784499.135908:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359588608 00000100:00100000:1.0:1790784499.135945:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790784499.135953:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945934a17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3281:x1877773359588608:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1790784499.135977:0:6670:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:1.0:1790784499.136006:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6abd33f0, atime: 0x6abd33f0, ctime: 0x6abd33f0, blocks: 0x1 00010000:00010000:1.0:1790784499.136014:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d42c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.136030:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=333s v=(0 0) 00010000:00010000:1.0:1790784499.136034:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784499.136040:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d42c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.136054:0:6670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d42c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.136064:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d42c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.136072:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d42c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.136089:0:6670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790784499.136515:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945934a17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3281:x1877773359588608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 561us (669us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1790784499.136523:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00010000:1.0:1790784499.136546:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790784499.136553:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d42c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.136723:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030c00 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:1.0:1790784499.136728:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d42c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.136737:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d42c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.136752:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d42c4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.136760:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d42c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.136776:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784499.136777:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784499.136779:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1790784499.136807:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94592d717800/2, rc 0, transno 4294967307 00000100:00100000:1.0:1790784499.136814:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359588608:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790784499.136899:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+18:11498:x1877773344913664:12345-192.168.206.32@tcp:44:lhsmtool_posix.0 Request processed in 39340us (39568us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784499.136916:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 182 00000020:00080000:2.0:1790784499.137218:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1790784499.137296:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359588736:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1790784499.137330:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784499.137362:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359588736 00000100:00100000:2.0:1790784499.137367:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359588736 00000100:00100000:2.0:1790784499.137413:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790784499.137421:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359588736:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1790784499.137526:0:6669:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1790784499.137529:0:6669:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790784498 00002000:00010000:2.0:1790784499.137532:0:6669:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790784499.137534:0:6669:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1790784498 -> 1790784498 00002000:00010000:2.0:1790784499.137537:0:6669:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1790784499.137857:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1877773359588736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 435us (524us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1790784499.137869:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:2.0:1790784499.137901:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94592d715500/2, rc 0, transno 4294967315 00000100:00100000:2.0:1790784499.137905:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359588736:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1790784499.141287:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784499.141354:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344913792 00000100:00100000:3.0:1790784499.141363:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344913792 00000100:00100000:3.0:1790784499.141436:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 55 00000100:00100000:3.0:1790784499.141447:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c3a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+10:2350:x1877773344913792:12345-192.168.206.32@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1790784499.199744:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790784499.218892:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:1.0:1790784499.218976:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:1.0:1790784499.219364:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c3a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2350:x1877773344913792:12345-192.168.206.32@tcp:16:lhsmtool_posix.0 Request processed in 77913us (78080us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784499.219392:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 55 00000100:00100000:1.0:1790784499.225079:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784499.225183:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344914048 00000100:00100000:3.0:1790784499.225192:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344914048 00000100:00100000:3.0:1790784499.225242:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 183 00000100:00100000:3.0:1790784499.225252:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c3a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+18:11498:x1877773344914048:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790784499.225297:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784499.225320:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524600/0x2c3a1e2a079d42af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813526e expref: 18 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784499.225336:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94592012a900) 00010000:00010000:3.0:1790784499.225341:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790784499.225364:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2ec00/0x2c3a1e2a079d42cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784499.225458:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2ec00/0x2c3a1e2a079d42cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784499.225469:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2ec00/0x2c3a1e2a079d42cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790784499.225691:0:5818:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001ebf7e17 reply state 00000000470e9462 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2ec00/0x2c3a1e2a079d42cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784499.225701:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790784499.225828:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c3a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+19:11498:x1877773344914048:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 Request processed in 576us (758us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1790784499.225848:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 183 00000100:00100000:1.0:1790784499.230823:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784499.230892:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344914176 00000100:00100000:3.0:1790784499.230901:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344914176 00000100:00100000:3.0:1790784499.230949:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 56 00000100:00100000:3.0:1790784499.230958:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c3a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2352:x1877773344914176:12345-192.168.206.32@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1790784499.231168:0:6669:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1790784499.231171:0:6669:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1790784498 -> 1790784497 00002000:00010000:3.0:1790784499.231174:0:6669:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1790784496 00002000:00010000:3.0:1790784499.231176:0:6669:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1790784498 -> 1790784497 00002000:00010000:3.0:1790784499.231179:0:6669:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1790784499.231223:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c3a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:2352:x1877773344914176:12345-192.168.206.32@tcp:2:lhsmtool_posix.0 Request processed in 265us (409us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1790784499.231230:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 56 00010000:00010000:2.0:1790784499.232512:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2ec00/0x2c3a1e2a079d42cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784499.232527:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2ec00/0x2c3a1e2a079d42cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784499.232544:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2ec00/0x2c3a1e2a079d42cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784499.232550:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2ec00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784499.232555:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2ec00/0x2c3a1e2a079d42cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784499.232683:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2ec00/0x2c3a1e2a079d42cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784499.232699:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94592012a900) 00010000:00010000:2.0:1790784499.232702:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784499.232707:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2ec00/0x2c3a1e2a079d42cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784499.232714:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2ec00/0x2c3a1e2a079d42cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784499.238622:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784499.238758:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344914432 00000100:00100000:1.0:1790784499.238767:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344914432 00000100:00100000:1.0:1790784499.238849:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 184 00000100:00100000:1.0:1790784499.238859:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fbbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+18:11498:x1877773344914432:12345-192.168.206.32@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1790784499.238921:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d42d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.238938:0:9249:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d4293 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135260 expref: 18 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.238947:0:9249:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d42d2 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.238981:0:9249:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d4293 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135260 expref: 18 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.238995:0:9249:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d4293 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135260 expref: 18 pid: 9249 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784499.239028:0:9249:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c3a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9249:1877773359588864:192.168.206.32@tcp:104: 00000100:00100000:1.0:1790784499.239110:0:9249:0:(client.c:2716:ptlrpc_set_wait()) set ffff945913122780 going to sleep for 11 seconds 00000100:00100000:0.0:1790784499.241582:0:9249:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c3a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9249:1877773359588864:192.168.206.32@tcp:104: 00010000:00010000:0.0:1790784499.241605:0:9249:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d42d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784499.242136:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784499.242339:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344914560 00000100:00100000:1.0:1790784499.242345:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344914560 00010000:00010000:1.0:1790784499.242408:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d4293 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135260 expref: 19 pid: 9249 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784499.242439:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 70 00000100:00100000:1.0:1790784499.242448:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fbba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+19:2351:x1877773344914560:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790784499.242461:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784499.242467:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d4293 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135260 expref: 19 pid: 9249 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.242479:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d4293 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135260 expref: 19 pid: 9249 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.242499:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525a00/0x2c3a1e2a079d4293 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135260 expref: 19 pid: 9249 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.242514:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94592012a900) 00010000:00010000:1.0:1790784499.242519:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d42d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.242529:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d42d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.242552:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d42d2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.242572:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790784499.242626:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fbba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+18:2351:x1877773344914560:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 178us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784499.242633:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 70 00010000:00010000:0.0:1790784499.243133:0:9249:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d42d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784499.243142:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d42d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784499.243177:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d42d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784499.243184:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d42d2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784499.243190:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d42d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784499.243196:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030e00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784499.243200:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d42d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784499.243207:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d42d2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784499.243216:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94592012a900) 00010000:00010000:0.0:1790784499.243219:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790784499.243223:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d42d2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784499.243229:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d42d2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784499.243281:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fbbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+17:11498:x1877773344914432:12345-192.168.206.32@tcp:55:lhsmtool_posix.0 Request processed in 4423us (4675us total) trans 0 rc -22/-22 00000100:00100000:0.0:1790784499.243290:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 184 00000100:00100000:0.0:1790784499.244855:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784499.244910:0:8181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344914688 00000100:00100000:1.0:1790784499.244916:0:8181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344914688 00000100:00100000:1.0:1790784499.244958:0:8181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 57 00000100:00100000:1.0:1790784499.244966:0:8181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fbb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:2350:x1877773344914688:12345-192.168.206.32@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1790784499.244999:0:8181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000182618ad/0x2c3a1e2a079d42d9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.245018:0:8181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d42bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.32@tcp remote: 0x394e0d883813527c expref: 8 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.245027:0:8181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784499.245031:0:8181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790784499.245035:0:8181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000182618ad/0x2c3a1e2a079d42d9 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.245064:0:8181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d42bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.32@tcp remote: 0x394e0d883813527c expref: 8 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.245077:0:8181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d42bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d883813527c expref: 8 pid: 6668 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784499.245099:0:8181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c3a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8181:1877773359588992:192.168.206.32@tcp:104: 00000100:00100000:1.0:1790784499.245160:0:8181:0:(client.c:2716:ptlrpc_set_wait()) set ffff945913122780 going to sleep for 11 seconds 00000100:00100000:2.0:1790784499.251093:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784499.251155:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344914816 00000100:00100000:3.0:1790784499.251163:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344914816 00010000:00010000:3.0:1790784499.251198:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d42bd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d883813527c expref: 9 pid: 6668 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784499.251240:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 71 00000100:00100000:3.0:1790784499.251248:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d714380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+9:2351:x1877773344914816:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790784499.251264:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784499.251284:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d42bd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d883813527c expref: 9 pid: 6668 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784499.251298:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d42bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d883813527c expref: 9 pid: 6668 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784499.251327:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790784499.251331:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790784499.251348:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000182618ad/0x2c3a1e2a079d42d9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784499.251358:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000182618ad/0x2c3a1e2a079d42d9 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784499.251406:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790784499.251448:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d714380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+9:2351:x1877773344914816:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 200us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784499.251456:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 71 00010000:00010000:1.0:1790784499.251868:0:8181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d42bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.32@tcp remote: 0x394e0d883813527c expref: 8 pid: 6668 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784499.251886:0:8181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c3a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8181:1877773359588992:192.168.206.32@tcp:104: 00010000:00010000:1.0:1790784499.251905:0:8181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000182618ad/0x2c3a1e2a079d42d9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.251916:0:8181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000182618ad/0x2c3a1e2a079d42d9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.251924:0:8181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000182618ad/0x2c3a1e2a079d42d9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.251949:0:8181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000182618ad/0x2c3a1e2a079d42d9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.251958:0:8181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000182618ad/0x2c3a1e2a079d42d9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.251967:0:8181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000182618ad/0x2c3a1e2a079d42d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.251986:0:8181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030c00 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:1.0:1790784499.251991:0:8181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000182618ad/0x2c3a1e2a079d42d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.252001:0:8181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000182618ad/0x2c3a1e2a079d42d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.252013:0:8181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000182618ad/0x2c3a1e2a079d42d9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.252020:0:8181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000182618ad/0x2c3a1e2a079d42d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784499.252102:0:8181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fbb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2350:x1877773344914688:12345-192.168.206.32@tcp:1:lhsmtool_posix.0 Request processed in 7137us (7252us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784499.252111:0:8181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 57 00000100:00100000:2.0:1790784499.261997:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784499.262353:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344915072 00000100:00100000:1.0:1790784499.262367:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344915072 00000100:00100000:1.0:1790784499.262467:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 185 00000100:00100000:1.0:1790784499.262478:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+17:11498:x1877773344915072:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790784499.262548:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d42e0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.262563:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d42e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.262592:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d42e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.262801:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d42e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.262812:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d42a1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135267 expref: 18 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.262820:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d42e7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.262855:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d42a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135267 expref: 18 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.262869:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d42a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135267 expref: 18 pid: 9249 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784499.262880:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c3a1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5819:1877773359589120:192.168.206.32@tcp:104: 00000100:00100000:1.0:1790784499.263010:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff945913122780 going to sleep for 11 seconds 00000100:00100000:2.0:1790784499.276478:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784499.276719:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344915200 00000100:00100000:3.0:1790784499.276730:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344915200 00000100:00100000:1.0:1790784499.276739:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c3a1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5819:1877773359589120:192.168.206.32@tcp:104: 00010000:00010000:1.0:1790784499.276769:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d42e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784499.276787:0:8480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d42a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135267 expref: 19 pid: 9249 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784499.276833:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 72 00000100:00100000:3.0:1790784499.276847:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d715c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b0f9e8c2-ddb0-4027-babe-0b166585860c+19:2351:x1877773344915200:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790784499.276865:0:8480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784499.276874:0:8480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d42a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135267 expref: 19 pid: 9249 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784499.276889:0:8480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d42a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135267 expref: 19 pid: 9249 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784499.277084:0:8480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d42a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135267 expref: 19 pid: 9249 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784499.277106:0:8480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94592012a900) 00010000:00010000:3.0:1790784499.277112:0:8480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d42e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784499.277123:0:8480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d42e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784499.277131:0:8480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d42e7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784499.277175:0:8480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790784499.277429:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d42e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.277441:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d42e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784499.277490:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d715c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b0f9e8c2-ddb0-4027-babe-0b166585860c+18:2351:x1877773344915200:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 644us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784499.277500:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 72 00000001:00080000:1.0:1790784499.277664:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1790784499.277817:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1790784499.277856:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1790784499.277934:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c3a1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5819:1877773359589248:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790784499.278778:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784499.278820:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459050c0480 going to sleep for 11 seconds 00000100:00100000:2.0:1790784499.278899:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359589248 00000100:00100000:2.0:1790784499.278907:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359589248 00000100:00100000:2.0:1790784499.278957:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790784499.278966:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c3a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5819:x1877773359589248:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790784499.279048:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c3a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5819:x1877773359589248:12345-0@lo:1000:mdt00_001.0 Request processed in 83us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784499.279056:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790784499.279127:0:5819:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1790784499.279132:0:5819:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94592d715500, transno 4294967315 00000100:00100000:1.0:1790784499.279148:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c3a1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5819:1877773359589248:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1790784499.280397:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1790784499.280462:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c3a1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5819:1877773359589376:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790784499.280500:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784499.280526:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff945913122cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790784499.280579:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359589376 00000100:00100000:0.0:1790784499.280593:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359589376 00000100:00100000:0.0:1790784499.280695:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790784499.280707:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c3a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5819:x1877773359589376:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790784499.281197:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c3a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5819:x1877773359589376:12345-0@lo:1000:mdt00_001.0 Request processed in 492us (694us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1790784499.281207:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790784499.281561:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c3a1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5819:1877773359589376:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1790784499.281624:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d42e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.281638:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d42e7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.281707:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d42e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.281716:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900031800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784499.281721:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d42e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.281731:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d42e7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.281764:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94592012a900) 00010000:00010000:1.0:1790784499.281768:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790784499.281774:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d42e7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.281782:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d42e7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.281823:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d421c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.281830:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d421c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.281836:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d421c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.281841:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945901524800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784499.281844:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d421c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.281989:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d421c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.281998:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94592012aa00) 00010000:00010000:1.0:1790784499.282001:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790784499.282004:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d421c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.282010:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524800/0x2c3a1e2a079d421c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784499.282124:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1400/0x2c3a1e2a079d42ee lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784499.282143:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d4238 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813524b expref: 21 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784499.282152:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1400/0x2c3a1e2a079d42ee lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784499.282192:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d4238 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813524b expref: 21 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784499.282211:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d4238 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813524b expref: 21 pid: 5818 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784499.282226:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593fbb8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5819:1877773359589504:192.168.206.32@tcp:104: 00000100:00100000:0.0:1790784499.282629:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593f57f600 going to sleep for 11 seconds 00000100:00100000:0.0:1790784499.289052:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593fbb8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5819:1877773359589504:192.168.206.32@tcp:104: 00010000:00010000:0.0:1790784499.289098:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1400/0x2c3a1e2a079d42ee lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784499.295265:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784499.295453:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344915328 00000100:00100000:1.0:1790784499.295468:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344915328 00010000:00010000:1.0:1790784499.295528:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d4238 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813524b expref: 22 pid: 5818 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784499.295592:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 73 00000100:00100000:1.0:1790784499.295603:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d715500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+22:2351:x1877773344915328:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790784499.295643:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784499.295662:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d4238 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813524b expref: 22 pid: 5818 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.295678:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d4238 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813524b expref: 22 pid: 5818 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.295707:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901524000/0x2c3a1e2a079d4238 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813524b expref: 22 pid: 5818 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.295834:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94592012aa00) 00010000:00010000:1.0:1790784499.295840:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1400/0x2c3a1e2a079d42ee lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.295862:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1400/0x2c3a1e2a079d42ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.295871:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1400/0x2c3a1e2a079d42ee lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.295907:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790784499.295999:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d715500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+21:2351:x1877773344915328:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 397us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784499.296008:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 73 00010000:00010000:0.0:1790784499.296438:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1400/0x2c3a1e2a079d42ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784499.296461:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1400/0x2c3a1e2a079d42ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784499.296477:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1400/0x2c3a1e2a079d42ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784499.296485:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1400/0x2c3a1e2a079d42ee lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784499.296493:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1400/0x2c3a1e2a079d42ee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784499.296499:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b1400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784499.296504:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1400/0x2c3a1e2a079d42ee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784499.296513:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1400/0x2c3a1e2a079d42ee lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784499.296524:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94592012aa00) 00010000:00010000:0.0:1790784499.296527:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784499.296532:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1400/0x2c3a1e2a079d42ee lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784499.296553:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1400/0x2c3a1e2a079d42ee lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784499.296570:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d42e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784499.296576:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d42e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784499.296591:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d42e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784499.296597:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030c00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784499.296600:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d42e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784499.296607:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d42e0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784499.296627:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94592012aa00) 00010000:00010000:0.0:1790784499.296630:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790784499.296633:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d42e0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784499.296639:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d42e0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784499.297412:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+20:11498:x1877773344915072:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 Request processed in 34930us (35426us total) trans 4294967467 rc 0/0 00000100:00100000:0.0:1790784499.297425:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 185 00000020:00080000:0.0:1790784499.297432:0:5819:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1790784499.297702:0:11656:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790784499.297931:0:11656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790784499.298979:0:11656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1790784499.299004:0:11656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790784499.306972:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784499.307127:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344915584 00000100:00100000:1.0:1790784499.307140:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344915584 00000100:00100000:1.0:1790784499.307209:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 50 00000100:00100000:1.0:1790784499.307221:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc17050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+20:11498:x1877773344915584:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1790784499.309150:0:5822:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1790784499.310423:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:1.0:1790784499.310529:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d42f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.310552:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d42f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.310566:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d42f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.310577:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d42f5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.310584:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d42f5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.310590:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d42f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784499.310790:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790784499.310952:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc17050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+22:11498:x1877773344915584:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 Request processed in 3728us (3987us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1790784499.310964:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 50 00000020:00080000:1.0:1790784499.310982:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790784499.311500:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790784499.311509:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d42f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784499.311518:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900031800 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:0.0:1790784499.311523:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d42f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784499.311544:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d42f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784499.311561:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94590345d500) 00010000:00010000:0.0:1790784499.311564:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790784499.311570:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d42f5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784499.311577:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d42f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784499.311599:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784499.311601:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784499.311603:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784500.220495:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790784500.269185:0:6693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:0.0:1790784500.269199:0:6693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:0.0:1790784500.269210:0:6693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000040:00080000:1.0:1790784501.150988:0:12481:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790784501.150997:0:12481:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790784501.151040:0:12481:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1790784501.151046:0:12481:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790784501.184938:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784501.185069:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784501.185104:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784501.185128:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784501.185155:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784501.185203:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344915712 00000100:00100000:0.0:1790784501.185212:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344915712 00000100:00100000:0.0:1790784501.185255:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 296 00000100:00100000:0.0:1790784501.185264:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903694850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2351:x1877773344915712:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:0.0:1790784501.185332:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903694850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2351:x1877773344915712:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 69us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784501.185340:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 296 00000100:00100000:2.0:1790784501.185507:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344916096 00000100:00100000:2.0:1790784501.185512:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344916096 00000100:00100000:2.0:1790784501.185547:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344915968 00000100:00100000:2.0:1790784501.185550:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344915968 00000100:00100000:2.0:1790784501.185574:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 76 00000100:00100000:2.0:1790784501.185582:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c3a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2351:x1877773344916096:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1790784501.185622:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c3a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2351:x1877773344916096:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 41us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784501.185629:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 76 00000100:00100000:2.0:1790784501.185643:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 77 00000100:00100000:2.0:1790784501.185650:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2351:x1877773344915968:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1790784501.185672:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2351:x1877773344915968:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 24us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784501.185691:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 77 00000100:00080000:0.0:1790784501.185963:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790784501.185968:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790784501.192329:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344915840 00000100:00100000:3.0:1790784501.192343:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344915840 00000100:00100000:3.0:1790784501.192438:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344916224 00000100:00100000:3.0:1790784501.192441:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344916224 00000100:00100000:3.0:1790784501.192472:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 155 00000100:00100000:3.0:1790784501.192481:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c3a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+22:2351:x1877773344915840:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1790784501.192565:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c3a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+22:2351:x1877773344915840:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 85us (7635us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784501.192573:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 155 00000100:00100000:3.0:1790784501.192590:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 156 00000100:00100000:3.0:1790784501.192620:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2351:x1877773344916224:12345-192.168.206.32@tcp:400:kworker.0 00000100:00080000:1.0:1790784501.193342:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790784501.193873:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2351:x1877773344916224:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 1250us (8712us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784501.193883:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 156 00010000:00010000:0.0:1790784501.244677:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784501.279696:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784501.279731:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344916480 00000100:00100000:3.0:1790784501.279740:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344916480 00000100:00100000:3.0:1790784501.279858:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 186 00000100:00100000:3.0:1790784501.279869:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+22:11517:x1877773344916480:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:3.0:1790784501.279887:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784501.279904:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d42fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135283 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.280223:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e200/0x2c3a1e2a079d4303 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.280238:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e200/0x2c3a1e2a079d4303 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.280249:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e200/0x2c3a1e2a079d4303 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790784501.280260:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1790784501.280677:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d42fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135283 expref: 25 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.280695:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e200/0x2c3a1e2a079d4303 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135283 expref: 24 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.280715:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94590345dc00) 00010000:00010000:3.0:1790784501.280718:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790784501.280722:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945802d2e200, rc 0) 00000100:00100000:3.0:1790784501.280851:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+24:11517:x1877773344916480:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 984us (1164us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1790784501.280859:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 186 00000100:00100000:2.0:1790784501.291330:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784501.292106:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344916608 00000100:00100000:3.0:1790784501.292116:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344916608 00000100:00100000:3.0:1790784501.292174:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 187 00000100:00100000:3.0:1790784501.292184:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+24:11517:x1877773344916608:12345-192.168.206.32@tcp:34:lfs.0 00010000:00010000:3.0:1790784501.292252:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d4311 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.292269:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d4311 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.292282:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d4311 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.292297:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f000/0x2c3a1e2a079d4318 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.292305:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f000/0x2c3a1e2a079d4318 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.292312:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f000/0x2c3a1e2a079d4318 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.292718:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d431f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.292728:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d431f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.292735:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d431f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790784501.292770:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d431f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.292782:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d4311 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.292788:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d4311 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.292795:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d4311 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.292801:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2e800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784501.292805:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d4311 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.292812:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d4311 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.292823:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94590345dc00) 00010000:00010000:3.0:1790784501.292826:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784501.292830:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d4311 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.296626:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d4311 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.296648:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f000/0x2c3a1e2a079d4318 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.296654:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f000/0x2c3a1e2a079d4318 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.296661:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f000/0x2c3a1e2a079d4318 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.296667:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2f000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784501.296671:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f000/0x2c3a1e2a079d4318 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.296678:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f000/0x2c3a1e2a079d4318 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.296692:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94592012ae00) 00010000:00010000:3.0:1790784501.296695:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784501.296699:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f000/0x2c3a1e2a079d4318 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.296705:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f000/0x2c3a1e2a079d4318 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.296724:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d431f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.296730:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d431f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.296744:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d431f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.296749:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2f400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784501.296752:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d431f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.296758:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d431f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.296764:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94592012a500) 00010000:00010000:3.0:1790784501.296766:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784501.296769:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d431f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.296775:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d431f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784501.297536:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+24:11517:x1877773344916608:12345-192.168.206.32@tcp:34:lfs.0 Request processed in 5346us (6208us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784501.297547:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 187 00000100:00100000:3.0:1790784501.376106:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784501.376220:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344916864 00000100:00100000:0.0:1790784501.376244:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344916864 00000100:00100000:0.0:1790784501.376313:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 188 00000100:00100000:0.0:1790784501.376323:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d300e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+24:11520:x1877773344916864:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:0.0:1790784501.376343:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784501.376362:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1200/0x2c3a1e2a079d4326 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813528a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.376470:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d432d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.376484:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d432d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.376509:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d432d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.376522:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4334 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.376529:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4334 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.376536:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4334 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.376764:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d433b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.376772:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d433b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.376780:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d433b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790784501.376792:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1790784501.376865:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d432d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.376872:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d432d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.376879:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d432d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.376885:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b1a00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784501.376889:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d432d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.376896:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d432d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.376907:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94590345dc00) 00010000:00010000:0.0:1790784501.376909:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784501.376914:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d432d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.376920:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d432d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.376932:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4334 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.376938:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4334 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.376952:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4334 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.376958:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b0200 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784501.376961:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4334 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.376966:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4334 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.376973:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff945903a23900) 00010000:00010000:0.0:1790784501.376975:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784501.376977:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4334 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.376983:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4334 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.377017:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1200/0x2c3a1e2a079d4326 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813528a expref: 27 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.377030:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d433b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813528a expref: 26 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.377037:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff945903a23200) 00010000:00010000:0.0:1790784501.377039:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790784501.377041:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b0600, rc 0) 00000100:00100000:0.0:1790784501.377097:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d300e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+26:11520:x1877773344916864:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 776us (1001us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1790784501.377111:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 188 00000100:00100000:2.0:1790784501.391483:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784501.392258:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344916992 00000100:00100000:1.0:1790784501.392331:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344916992 00000100:00100000:1.0:1790784501.392502:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 189 00000100:00100000:1.0:1790784501.392513:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+26:11520:x1877773344916992:12345-192.168.206.32@tcp:54:lfs.0 00010000:00010000:1.0:1790784501.392573:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4349 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.392590:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.392611:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.392635:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.392641:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4349 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.392648:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4349 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.392664:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784501.392668:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4349 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.392675:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4349 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.392685:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff945903a23200) 00010000:00010000:1.0:1790784501.392688:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790784501.392692:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4349 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.392698:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4349 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784501.392940:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+26:11520:x1877773344916992:12345-192.168.206.32@tcp:54:lfs.0 Request processed in 429us (1464us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784501.392948:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 189 00000100:00100000:2.0:1790784501.401698:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784501.401775:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344917248 00000100:00100000:1.0:1790784501.401784:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344917248 00000100:00100000:1.0:1790784501.401846:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 51 00000100:00100000:1.0:1790784501.401856:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+26:11520:x1877773344917248:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:1.0:1790784501.402082:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+27:11520:x1877773344917248:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 227us (391us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1790784501.402089:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 51 00000100:00100000:2.0:1790784501.461596:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784501.461752:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344917504 00000100:00100000:0.0:1790784501.461761:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344917504 00000100:00100000:0.0:1790784501.461820:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 190 00000100:00100000:0.0:1790784501.461829:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+27:11046:x1877773344917504:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:0.0:1790784501.461851:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784501.461870:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1200/0x2c3a1e2a079d4350 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135291 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.461955:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4357 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.461969:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d433b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813528a expref: 28 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.461978:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4357 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.462018:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d433b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813528a expref: 28 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.462030:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d433b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813528a expref: 28 pid: 5820 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784501.462043:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593fbb8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5820:1877773359589632:192.168.206.32@tcp:104: 00000100:00100000:0.0:1790784501.462126:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593f57f840 going to sleep for 11 seconds 00000100:00100000:2.0:1790784501.472071:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784501.472760:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344917632 00000100:00100000:3.0:1790784501.472773:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344917632 00010000:00010000:3.0:1790784501.472831:0:8421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d433b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813528a expref: 29 pid: 5820 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784501.472889:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 74 00000100:00100000:3.0:1790784501.472900:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f495880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+29:2351:x1877773344917632:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790784501.472939:0:8421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784501.472947:0:8421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d433b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813528a expref: 29 pid: 5820 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.472962:0:8421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d433b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813528a expref: 29 pid: 5820 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.472989:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff945903a23200) 00010000:00010000:3.0:1790784501.472995:0:8421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4357 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.473006:0:8421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4357 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.473014:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4357 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.473036:0:8421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790784501.473110:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f495880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+29:2351:x1877773344917632:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 211us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784501.473118:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 74 00010000:00010000:0.0:1790784501.473877:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d433b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813528a expref: 28 pid: 5820 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784501.473909:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593fbb8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5820:1877773359589632:192.168.206.32@tcp:104: 00010000:00010000:0.0:1790784501.473942:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4357 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.473954:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4357 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.473960:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4357 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790784501.473984:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1790784501.474198:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1200/0x2c3a1e2a079d4350 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135291 expref: 29 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.474220:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4357 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135291 expref: 28 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.474228:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff945903a23200) 00010000:00010000:0.0:1790784501.474232:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790784501.474235:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b0200, rc 0) 00000100:00100000:0.0:1790784501.474301:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+28:11046:x1877773344917504:12345-192.168.206.32@tcp:101:bash.0 Request processed in 12472us (12712us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1790784501.474310:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 190 00000100:00100000:2.0:1790784501.478087:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784501.479630:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344917888 00000100:00100000:3.0:1790784501.479818:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344917888 00000100:00100000:3.0:1790784501.479911:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 191 00000100:00100000:3.0:1790784501.479923:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f4b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+28:11046:x1877773344917888:12345-192.168.206.32@tcp:36:bash.0 00010000:00010000:3.0:1790784501.480289:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4365 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.480311:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4365 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.480344:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4365 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790784501.481055:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:3.0:1790784501.481097:0:5819:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ffc84eb2 reply state 00000000ddc06ee6 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4365 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784501.481109:0:5819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1790784501.481193:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:3.0:1790784501.481400:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f4b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+32:11046:x1877773344917888:12345-192.168.206.32@tcp:36:bash.0 Request processed in 1449us (3298us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1790784501.481411:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 191 00000020:00080000:3.0:1790784501.481418:0:5819:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1790784501.487370:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784501.487614:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344918016 00000100:00100000:0.0:1790784501.487627:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344918016 00000100:00100000:0.0:1790784501.487713:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 192 00000100:00100000:0.0:1790784501.487725:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+32:11046:x1877773344918016:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:0.0:1790784501.487776:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784501.487802:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1200/0x2c3a1e2a079d436c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135298 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.487880:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1200/0x2c3a1e2a079d436c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135298 expref: 33 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.487896:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1200/0x2c3a1e2a079d436c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135298 expref: 33 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.487918:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff945903a23200) 00010000:00010000:0.0:1790784501.487921:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790784501.487925:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b1200, rc 0) 00000100:00100000:0.0:1790784501.488000:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+33:11046:x1877773344918016:12345-192.168.206.32@tcp:101:bash.0 Request processed in 278us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784501.488007:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 192 00010000:00010000:3.0:1790784501.488912:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4365 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.488926:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4365 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.488935:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4365 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.488942:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2f400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784501.488947:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4365 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.488957:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4365 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.488972:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff945903a23200) 00010000:00010000:3.0:1790784501.488988:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784501.488994:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4365 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.488999:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4365 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784501.494328:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784501.494476:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344918144 00000100:00100000:0.0:1790784501.494490:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344918144 00000100:00100000:0.0:1790784501.494564:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 58 00000100:00100000:0.0:1790784501.494577:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459056d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:11046:x1877773344918144:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:0.0:1790784501.494609:0:6669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784501.494646:0:6669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3d350b8/0x2c3a1e2a079d4373 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813529f expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790784501.494681:0:6669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6abd33f1, atime: 0x6abd33f0, ctime: 0x6abd33f1, blocks: 0xb 00010000:00010000:0.0:1790784501.494710:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=335s v=(0 0) 00010000:00010000:0.0:1790784501.494715:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790784501.494742:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3d350b8/0x2c3a1e2a079d4373 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813529f expref: 8 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.494762:0:6669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e3d350b8/0x2c3a1e2a079d4373 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813529f expref: 8 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.494778:0:6669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b0600, rc 0) 00000100:00100000:0.0:1790784501.494851:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459056d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:11046:x1877773344918144:12345-192.168.206.32@tcp:101:bash.0 Request processed in 276us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784501.494858:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 58 00000100:00100000:2.0:1790784501.502054:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784501.502971:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344918272 00000100:00100000:0.0:1790784501.502987:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344918272 00002000:00010000:0.0:1790784501.503059:0:6673:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1790784501.503065:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94592dac9180 with x1877773344918272 ext(0->18446744073709551615) 00002000:00010000:0.0:1790784501.503083:0:6673:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94592dac9180. 00000100:00100000:0.0:1790784501.503141:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 5 00000100:00100000:0.0:1790784501.503153:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592dac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:2352:x1877773344918272:12345-192.168.206.32@tcp:10:bash.0 00002000:00010000:0.0:1790784501.503559:0:6673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1790784501.503563:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1790784497 -> 1790784501 00002000:00010000:0.0:1790784501.503566:0:6673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1790784496 -> 1790784496 00002000:00010000:0.0:1790784501.503568:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1790784497 -> 1790784501 00002000:00010000:0.0:1790784501.503571:0:6673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1790784501.503683:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592dac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+9:2352:x1877773344918272:12345-192.168.206.32@tcp:10:bash.0 Request processed in 530us (1641us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1790784501.503692:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 5 00002000:00010000:0.0:1790784501.503697:0:6673:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1790784501.503718:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94592dac9180 with x1877773344918272 ext(0->18446744073709551615) 00002000:00010000:0.0:1790784501.503724:0:6673:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94592dac9180. 00000100:00100000:2.0:1790784501.629332:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784501.629610:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344918400 00000100:00100000:0.0:1790784501.629625:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344918400 00000100:00100000:0.0:1790784501.629711:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 193 00000100:00100000:0.0:1790784501.629725:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592dac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+32:11534:x1877773344918400:12345-192.168.206.32@tcp:34:lfs.0 00010000:00010000:0.0:1790784501.629824:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d437a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.629845:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d437a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.629859:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d437a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.629876:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d4381 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.629884:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d4381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.629890:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d4381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.630208:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d4388 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.630219:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d4388 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.630228:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d4388 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790784501.630304:0:9249:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d4388 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.630319:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d437a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.630325:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d437a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.630332:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d437a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.630338:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b1a00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784501.630342:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d437a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.630351:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d437a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.631501:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94590345dc00) 00010000:00010000:0.0:1790784501.631505:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784501.631514:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d437a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.631523:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d437a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.631547:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d4381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.631554:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d4381 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.631577:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d4381 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.631583:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b1600 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784501.631587:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d4381 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.631594:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d4381 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.631615:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff945903a23f00) 00010000:00010000:0.0:1790784501.631618:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784501.631622:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d4381 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.631628:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d4381 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.632035:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d4388 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.632044:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d4388 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.632050:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d4388 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.632055:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b0400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784501.632058:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d4388 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.632078:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d4388 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.632087:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff945903a23200) 00010000:00010000:0.0:1790784501.632089:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784501.632093:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d4388 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.632098:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d4388 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784501.632228:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592dac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+32:11534:x1877773344918400:12345-192.168.206.32@tcp:34:lfs.0 Request processed in 2500us (2903us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784501.632239:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 193 00000100:00100000:2.0:1790784501.722211:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784501.722371:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344918656 00000100:00100000:0.0:1790784501.722438:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344918656 00000100:00100000:0.0:1790784501.722513:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 194 00000100:00100000:0.0:1790784501.722526:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+32:11537:x1877773344918656:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:0.0:1790784501.722557:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784501.722585:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d438f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381352a6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.722918:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d4396 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.722936:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d4396 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.722949:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d4396 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.722982:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d439d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.722990:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d439d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.722996:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d439d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.723322:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d43a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.723333:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d43a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.723342:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d43a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790784501.726514:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1790784501.729008:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d4396 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.729031:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d4396 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.729041:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d4396 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.729049:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b1600 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784501.729055:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d4396 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.729090:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d4396 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.729114:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94590345dc00) 00010000:00010000:0.0:1790784501.729118:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784501.729125:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d4396 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.729131:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d4396 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.729153:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d439d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.729159:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d439d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.729165:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d439d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.729170:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b1a00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784501.729174:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d439d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.729180:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d439d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.729188:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff945903a23f00) 00010000:00010000:0.0:1790784501.729191:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784501.729195:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d439d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.729212:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d439d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.729284:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d438f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352a6 expref: 35 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.729302:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d43a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352a6 expref: 34 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.729309:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff945903a23200) 00010000:00010000:0.0:1790784501.729312:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790784501.729315:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b1000, rc 0) 00000100:00100000:0.0:1790784501.729465:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+34:11537:x1877773344918656:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 6941us (7268us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1790784501.729476:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 194 00000100:00100000:2.0:1790784501.735173:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784501.735321:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344918784 00000100:00100000:3.0:1790784501.735335:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344918784 00000100:00100000:2.0:1790784501.742826:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 195 00000100:00100000:2.0:1790784501.742853:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+34:11537:x1877773344918784:12345-192.168.206.32@tcp:54:lfs.0 00010000:00010000:2.0:1790784501.742951:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d43b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784501.742971:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4357 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135291 expref: 34 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784501.742981:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d43b2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784501.743028:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4357 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135291 expref: 34 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784501.743067:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4357 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135291 expref: 34 pid: 5820 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784501.743085:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94591aa56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5819:1877773359589760:192.168.206.32@tcp:104: 00000100:00100000:2.0:1790784501.743231:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff945904fd7840 going to sleep for 11 seconds 00000100:00100000:2.0:1790784501.749971:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784501.750990:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344919040 00000100:00100000:1.0:1790784501.751007:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344919040 00000100:00100000:1.0:1790784501.751101:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 52 00000100:00100000:1.0:1790784501.751132:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459102e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+35:5591:x1877773344919040:12345-192.168.206.32@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790784501.751925:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459102e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+36:5591:x1877773344919040:12345-192.168.206.32@tcp:35:ldlm_bl.0 Request processed in 791us (1963us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1790784501.751944:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 52 00000100:00100000:0.0:1790784501.753065:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94591aa56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5819:1877773359589760:192.168.206.32@tcp:104: 00010000:00010000:0.0:1790784501.753107:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d43b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784501.758155:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784501.758331:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344919168 00000100:00100000:2.0:1790784501.758345:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344919168 00010000:00010000:2.0:1790784501.758454:0:8480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4357 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135291 expref: 36 pid: 5820 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784501.758507:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 75 00000100:00100000:2.0:1790784501.758518:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d302a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b0f9e8c2-ddb0-4027-babe-0b166585860c+36:2352:x1877773344919168:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790784501.758537:0:8480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784501.758544:0:8480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4357 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135291 expref: 36 pid: 5820 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784501.758559:0:8480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4357 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135291 expref: 36 pid: 5820 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784501.758610:0:8480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4357 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135291 expref: 36 pid: 5820 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784501.758632:0:8480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff945903a23200) 00010000:00010000:2.0:1790784501.758648:0:8480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d43b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784501.758809:0:8480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d43b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784501.758819:0:8480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d43b2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784501.758850:0:8480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790784501.760109:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d302a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b0f9e8c2-ddb0-4027-babe-0b166585860c+35:2352:x1877773344919168:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 1581us (1957us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784501.760123:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 75 00010000:00010000:0.0:1790784501.761222:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d43b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.761241:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d43b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.761289:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d43b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.761323:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d43b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.761331:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d43b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.761338:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75600 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784501.761344:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d43b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.761352:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d43b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.761370:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff945903a23200) 00010000:00010000:0.0:1790784501.761415:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790784501.761422:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d43b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.761429:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d43b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784501.761532:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+34:11537:x1877773344918784:12345-192.168.206.32@tcp:54:lfs.0 Request processed in 18686us (26455us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784501.761542:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 195 00000100:00100000:2.0:1790784501.771687:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784501.772123:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344919424 00000100:00100000:3.0:1790784501.772136:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344919424 00000100:00100000:3.0:1790784501.772210:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 53 00000100:00100000:3.0:1790784501.772222:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459102e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+34:11537:x1877773344919424:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:1.0:1790784501.777182:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459102e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+35:11537:x1877773344919424:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 4945us (5501us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1790784501.777200:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 53 00000100:00100000:2.0:1790784501.881533:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784501.882577:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344919680 00000100:00100000:1.0:1790784501.882594:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344919680 00000100:00100000:1.0:1790784501.883148:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 196 00000100:00100000:1.0:1790784501.883162:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+35:11548:x1877773344919680:12345-192.168.206.32@tcp:101:cat.0 00010000:00010000:1.0:1790784501.883199:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784501.883228:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d43b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381352ad expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.883329:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d43c0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.883347:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d43c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.883363:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d43c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.883413:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d43c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.883422:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d43c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.883448:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d43c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.884221:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d43ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.884234:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d43ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.884243:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d43ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790784501.884257:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1790784501.884419:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d43c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.884430:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d43c0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.884436:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d43c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.884443:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030e00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784501.884448:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d43c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.884458:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d43c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.884473:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94590345dc00) 00010000:00010000:1.0:1790784501.884477:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784501.884496:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d43c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.884503:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d43c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.884521:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d43c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.884528:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d43c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.884533:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d43c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.884538:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900031c00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784501.884541:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d43c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.884548:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d43c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.884556:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94590345d500) 00010000:00010000:1.0:1790784501.884559:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784501.884562:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d43c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.884568:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d43c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.884810:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d43b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352ad expref: 38 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.884842:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d43ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352ad expref: 37 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.884850:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff945903a23200) 00010000:00010000:1.0:1790784501.884853:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790784501.884856:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945900031800, rc 0) 00000100:00100000:1.0:1790784501.885139:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+37:11548:x1877773344919680:12345-192.168.206.32@tcp:101:cat.0 Request processed in 1979us (3617us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1790784501.885149:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 196 00000100:00100000:2.0:1790784501.894282:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784501.894458:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344919936 00000100:00100000:1.0:1790784501.894473:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344919936 00000100:00100000:0.0:1790784501.894802:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 54 00000100:00100000:0.0:1790784501.894815:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+37:11548:x1877773344919936:12345-192.168.206.32@tcp:35:cat.0 00000100:00100000:0.0:1790784501.895116:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+38:11548:x1877773344919936:12345-192.168.206.32@tcp:35:cat.0 Request processed in 302us (847us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1790784501.895145:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 54 00000100:00100000:2.0:1790784501.913269:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784501.913371:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344920192 00000100:00100000:0.0:1790784501.913416:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344920192 00000100:00100000:0.0:1790784501.913490:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 197 00000100:00100000:0.0:1790784501.913501:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+38:11549:x1877773344920192:12345-192.168.206.32@tcp:36:rm.0 00010000:00010000:0.0:1790784501.913576:0:9249:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790784501.913621:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d43ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352ad expref: 38 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.913822:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d43a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352a6 expref: 37 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.913849:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1200/0x2c3a1e2a079d436c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135298 expref: 36 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.914059:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff945903a23200) 00010000:00010000:0.0:1790784501.914076:0:9249:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790784501.914109:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d43dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.914128:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d43dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.914140:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d43dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.914157:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d43e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.914188:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d43e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.914194:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d43e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.914528:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d43ea lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.914537:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d43ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.914544:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d43ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790784501.917549:0:9249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1790784501.917578:0:9249:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 336067202536ns, next at 337067197570ns, rc = 0 00010000:00010000:0.0:1790784501.917755:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d43f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.917776:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d43f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.917788:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d43f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.917798:0:9249:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d43f1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.917804:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d43f1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.917830:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d43f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.917862:0:9249:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790784501.917889:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d43ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.917895:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d43ea lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.917901:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d43ea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.917906:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b1600 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784501.917911:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d43ea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.917919:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d43ea lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.917931:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff945903a23300) 00010000:00010000:0.0:1790784501.917934:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1790784501.917938:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d43ea lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.917943:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d43ea lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.917971:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d43dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.917976:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d43dc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.917988:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d43dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.917992:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b0400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784501.917995:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d43dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.918001:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d43dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.918009:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94590345dc00) 00010000:00010000:0.0:1790784501.918011:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784501.918014:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d43dc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.918020:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d43dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790784501.918031:0:9249:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e5fc2432 reply state 00000000a14ce954 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d43e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784501.918041:0:9249:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790784501.918177:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+37:11549:x1877773344920192:12345-192.168.206.32@tcp:36:rm.0 Request processed in 4662us (4908us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1790784501.918188:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 197 00010000:00010000:2.0:1790784501.918370:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790784501.918422:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d43f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784501.918428:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b0c00 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:2.0:1790784501.918431:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d43f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784501.918438:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d43f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784501.918448:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff945903a23300) 00010000:00010000:2.0:1790784501.918451:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790784501.918453:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d43f1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784501.918470:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d43f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784501.918487:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784501.918489:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784501.918491:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784501.925065:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d43e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.925090:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d43e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.925099:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d43e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.925105:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b1a00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784501.925112:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d43e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.925121:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d43e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.925143:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff945903a23f00) 00010000:00010000:3.0:1790784501.925179:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784501.925186:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d43e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.925193:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d43e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784501.974901:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784501.975115:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344920448 00000100:00100000:0.0:1790784501.975131:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344920448 00000100:00100000:0.0:1790784501.975205:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 198 00000100:00100000:0.0:1790784501.975217:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+36:11555:x1877773344920448:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:0.0:1790784501.975279:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784501.975310:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d43f8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381352b4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.975521:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d43ff lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.975539:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d43ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.975552:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d43ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.975568:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1200/0x2c3a1e2a079d4406 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.975576:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1200/0x2c3a1e2a079d4406 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784501.975583:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1200/0x2c3a1e2a079d4406 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790784501.978361:0:5818:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1790784501.979035:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d440d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784501.979058:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d440d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784501.979072:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d440d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784501.979188:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d43ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784501.979196:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d43ff lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784501.979205:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d43ff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784501.979211:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b1600 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784501.979216:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d43ff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784501.979224:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d43ff lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784501.979250:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94590345dc00) 00010000:00010000:2.0:1790784501.979254:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784501.979260:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d43ff lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784501.979267:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d43ff lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790784501.979290:0:5818:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ead2c9d reply state 00000000ba38f8d5 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1200/0x2c3a1e2a079d4406 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784501.979300:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790784501.979344:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d43f8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352b4 expref: 39 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784501.979360:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d440d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352b4 expref: 38 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784501.979369:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff945903af2a00) 00010000:00010000:2.0:1790784501.979372:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790784501.979830:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74400, rc 0) 00000100:00100000:2.0:1790784501.979946:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+39:11555:x1877773344920448:12345-192.168.206.32@tcp:101:bash.0 Request processed in 4730us (5058us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1790784501.979956:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 198 00000100:00100000:2.0:1790784501.983347:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784501.983461:0:8181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344920576 00000100:00100000:1.0:1790784501.983474:0:8181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344920576 00000100:00100000:1.0:1790784501.983561:0:8181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 59 00000100:00100000:1.0:1790784501.983573:0:8181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d565180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2350:x1877773344920576:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:1.0:1790784501.983614:0:8181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784501.983647:0:8181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d441b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381352bb expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790784501.983691:0:8181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790784501.983717:0:8181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=336s v=(0 0) 00010000:00010000:1.0:1790784501.983723:0:8181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784501.983733:0:8181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d441b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352bb expref: 6 pid: 8181 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.983755:0:8181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d441b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352bb expref: 6 pid: 8181 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784501.983788:0:8181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945900030000, rc 0) 00000100:00100000:1.0:1790784501.983875:0:8181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d565180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2350:x1877773344920576:12345-192.168.206.32@tcp:101:bash.0 Request processed in 304us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784501.983882:0:8181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 59 00010000:00010000:3.0:1790784501.988003:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1200/0x2c3a1e2a079d4406 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.988025:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1200/0x2c3a1e2a079d4406 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.988035:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1200/0x2c3a1e2a079d4406 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.988043:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b1200 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784501.988049:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1200/0x2c3a1e2a079d4406 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.988058:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1200/0x2c3a1e2a079d4406 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.988655:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff945903a23200) 00010000:00010000:3.0:1790784501.988661:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784501.988669:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1200/0x2c3a1e2a079d4406 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784501.988686:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1200/0x2c3a1e2a079d4406 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784501.990957:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784501.991240:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344920704 00000100:00100000:2.0:1790784501.991253:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344920704 00000100:00100000:2.0:1790784501.991367:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 60 00000100:00100000:2.0:1790784501.991527:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fbb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:11555:x1877773344920704:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:2.0:1790784501.991569:0:6669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784501.991618:0:6669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085f6a75c/0x2c3a1e2a079d4422 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381352c2 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784501.991668:0:6669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d441b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352bb expref: 7 pid: 8181 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784501.991823:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790784501.991828:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790784501.991842:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085f6a75c/0x2c3a1e2a079d4422 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352c2 expref: 7 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784501.991884:0:6669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d441b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352bb expref: 7 pid: 8181 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784501.991900:0:6669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d441b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352bb expref: 7 pid: 8181 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784501.991917:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d564a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6669:1877773359589888:192.168.206.32@tcp:104: 00000100:00100000:2.0:1790784501.992076:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff945904fd7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790784502.000092:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784502.000253:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344920832 00000100:00100000:3.0:1790784502.000285:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344920832 00010000:00010000:3.0:1790784502.000341:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d441b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352bb expref: 8 pid: 8181 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784502.000452:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 76 00000100:00100000:3.0:1790784502.000465:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905106850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:2352:x1877773344920832:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790784502.000484:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784502.000531:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d441b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352bb expref: 8 pid: 8181 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.000556:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d441b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352bb expref: 8 pid: 8181 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.000589:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784502.000594:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784502.000617:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000085f6a75c/0x2c3a1e2a079d4422 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352c2 expref: 8 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.000628:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085f6a75c/0x2c3a1e2a079d4422 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352c2 expref: 8 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.000685:0:5803:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000085f6a75c/0x2c3a1e2a079d4422 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352c2 expref: 8 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784502.000713:0:5803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d300380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5803:1877773359590016:192.168.206.32@tcp:105: 00000100:00100000:3.0:1790784502.000828:0:5803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459051ad900 going to sleep for 11 seconds 00000100:00100000:3.0:1790784502.003627:0:5803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d300380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5803:1877773359590016:192.168.206.32@tcp:105: 00010000:00010000:3.0:1790784502.004333:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790784502.004457:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905106850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:2352:x1877773344920832:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 3990us (4386us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784502.004471:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 76 00010000:00010000:2.0:1790784502.005431:0:6669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d441b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352bb expref: 7 pid: 8181 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784502.005461:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d564a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6669:1877773359589888:192.168.206.32@tcp:104: 00010000:00010000:2.0:1790784502.005492:0:6669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000085f6a75c/0x2c3a1e2a079d4422 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352c2 expref: 6 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.005530:0:6669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe75200, rc 0) 00000100:00100000:2.0:1790784502.007815:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fbb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:11555:x1877773344920704:12345-192.168.206.32@tcp:101:bash.0 Request processed in 14060us (15006us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784502.007845:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 60 00000100:00100000:1.0:1790784502.010538:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784502.010783:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344921088 00000100:00100000:0.0:1790784502.010795:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344921088 00000100:00100000:0.0:1790784502.010865:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 55 00000100:00100000:0.0:1790784502.010877:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+38:11555:x1877773344921088:12345-192.168.206.32@tcp:35:bash.0 00000100:00100000:0.0:1790784502.013266:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+39:11555:x1877773344921088:12345-192.168.206.32@tcp:35:bash.0 Request processed in 2374us (2726us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1790784502.013307:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 55 00000100:00100000:2.0:1790784502.264997:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784502.265190:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344921216 00000100:00100000:0.0:1790784502.265203:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344921216 00000100:00100000:0.0:1790784502.265279:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 199 00000100:00100000:0.0:1790784502.265291:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d564a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+39:11571:x1877773344921216:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:0.0:1790784502.265324:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784502.265350:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d4429 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381352c9 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.265485:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d4430 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.265505:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d4430 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.265519:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d4430 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790784502.265572:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1790784502.265577:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790784502.265609:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d4430 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.265640:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d4429 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352c9 expref: 41 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.265662:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d4430 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352c9 expref: 40 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.265696:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94590345dc00) 00010000:00010000:0.0:1790784502.265699:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790784502.265704:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b1c00, rc 0) 00000100:00100000:0.0:1790784502.265783:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d564a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+40:11571:x1877773344921216:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 495us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784502.265792:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 199 00010000:00010000:0.0:1790784502.266755:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784502.273000:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784502.273644:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344921472 00000100:00100000:0.0:1790784502.273658:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344921472 00000100:00100000:0.0:1790784502.273740:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 200 00000100:00100000:0.0:1790784502.273753:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+40:11571:x1877773344921472:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:0.0:1790784502.273782:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784502.273810:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0e00/0x2c3a1e2a079d4437 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381352d0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.274052:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1400/0x2c3a1e2a079d443e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.274071:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1400/0x2c3a1e2a079d443e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.274085:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1400/0x2c3a1e2a079d443e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790784502.274098:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1790784502.274627:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0e00/0x2c3a1e2a079d4437 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352d0 expref: 43 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.274678:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1400/0x2c3a1e2a079d443e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352d0 expref: 42 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.274688:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff945903af2a00) 00010000:00010000:0.0:1790784502.274691:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790784502.274696:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b1400, rc 0) 00000100:00100000:0.0:1790784502.274859:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+42:11571:x1877773344921472:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 1109us (1874us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1790784502.274867:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 200 00000100:00100000:2.0:1790784502.291566:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784502.291722:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784502.291909:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344921856 00000100:00100000:1.0:1790784502.291922:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344921856 00000100:00100000:1.0:1790784502.292008:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 14 00000100:00100000:1.0:1790784502.292020:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d567800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+42:2351:x1877773344921856:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790784502.292039:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784502.292072:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1400/0x2c3a1e2a079d443e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352d0 expref: 42 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.292099:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff945903af2a00) 00010000:00010000:1.0:1790784502.292106:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790784502.292188:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d567800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+41:2351:x1877773344921856:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 171us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784502.292196:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 14 00000100:00100000:0.0:1790784502.301744:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344921728 00000100:00100000:0.0:1790784502.301768:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344921728 00000100:00100000:0.0:1790784502.301920:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 201 00000100:00100000:0.0:1790784502.301933:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+41:11571:x1877773344921728:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:0.0:1790784502.301969:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784502.301996:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0e00/0x2c3a1e2a079d444c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381352d7 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.302126:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d4453 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.302145:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d4453 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.302159:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d4453 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790784502.302174:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1790784502.302406:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0e00/0x2c3a1e2a079d444c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352d7 expref: 44 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.302432:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d4453 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352d7 expref: 43 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.302442:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff945903af2a00) 00010000:00010000:0.0:1790784502.302445:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790784502.302449:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b0800, rc 0) 00000100:00100000:0.0:1790784502.302563:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+43:11571:x1877773344921728:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 632us (11012us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1790784502.302571:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 201 00000100:00100000:2.0:1790784502.323908:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784502.324896:0:8181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344921984 00000100:00100000:3.0:1790784502.324913:0:8181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344921984 00000100:00100000:3.0:1790784502.324999:0:8181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 61 00000100:00100000:3.0:1790784502.325011:0:8181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d566d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+6:2351:x1877773344921984:12345-192.168.206.32@tcp:1:lfs.0 00010000:00010000:3.0:1790784502.325072:0:8181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000810546d4/0x2c3a1e2a079d4461 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.325099:0:8181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000085f6a75c/0x2c3a1e2a079d4422 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352c2 expref: 6 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.325111:0:8181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784502.325116:0:8181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790784502.325121:0:8181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000810546d4/0x2c3a1e2a079d4461 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.325167:0:8181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000085f6a75c/0x2c3a1e2a079d4422 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352c2 expref: 6 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.325570:0:8181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000085f6a75c/0x2c3a1e2a079d4422 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352c2 expref: 6 pid: 6669 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784502.325629:0:8181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d300380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8181:1877773359590144:192.168.206.32@tcp:104: 00000100:00100000:3.0:1790784502.325764:0:8181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459051ad0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790784502.328840:0:8181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d300380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8181:1877773359590144:192.168.206.32@tcp:104: 00010000:00010000:0.0:1790784502.328880:0:8181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000810546d4/0x2c3a1e2a079d4461 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784502.331554:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784502.331672:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344922112 00000100:00100000:0.0:1790784502.331685:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344922112 00002000:00100000:0.0:1790784502.331753:0:6674:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff94592d566300 x1877773344922112/t0(0) o4->b0f9e8c2-ddb0-4027-babe-0b166585860c@192.168.206.32@tcp:13/0 lens 504/0 e 0 to 0 dl 1790784513 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790784502.331766:0:6674:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94592d566300 with x1877773344922112 ext(0->8) 00010000:00010000:0.0:1790784502.331776:0:6674:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000085f6a75c/0x2c3a1e2a079d4422 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352c2 expref: 7 pid: 6669 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.331795:0:6674:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000085f6a75c/0x2c3a1e2a079d4422 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352c2 expref: 7 pid: 6669 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790784502.331827:0:6674:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff94592d566300 00000100:00100000:0.0:1790784502.331870:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 3 00000100:00100000:0.0:1790784502.331891:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d566300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2352:x1877773344922112:12345-192.168.206.32@tcp:4:lfs.0 00000100:00100000:2.0:1790784502.333814:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d566300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+9:2352:x1877773344922112:12345-192.168.206.32@tcp:4:lfs.0 Request processed in 1917us (2256us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1790784502.333830:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 3 00002000:00100000:2.0:1790784502.333846:0:6674:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff94592d566300 x1877773344922112/t4294967308(0) o4->b0f9e8c2-ddb0-4027-babe-0b166585860c@192.168.206.32@tcp:13/0 lens 504/448 e 0 to 0 dl 1790784513 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790784502.333857:0:6674:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94592d566300 with x1877773344922112 ext(0->8) 00010000:00010000:2.0:1790784502.333869:0:6674:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000085f6a75c/0x2c3a1e2a079d4422 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352c2 expref: 9 pid: 6669 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.333983:0:6674:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000085f6a75c/0x2c3a1e2a079d4422 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352c2 expref: 9 pid: 6669 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790784502.333994:0:6674:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff94592d566300 00000100:00100000:3.0:1790784502.341320:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784502.341419:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344922240 00000100:00100000:1.0:1790784502.341432:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344922240 00010000:00010000:1.0:1790784502.341496:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000085f6a75c/0x2c3a1e2a079d4422 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352c2 expref: 9 pid: 6669 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784502.341548:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 77 00000100:00100000:1.0:1790784502.341560:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d303b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+9:2352:x1877773344922240:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790784502.341610:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1790784502.341637:0:5804:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1790784502.341641:0:5804:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790784501 00002000:00010000:1.0:1790784502.341643:0:5804:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1790784502 00002000:00010000:1.0:1790784502.341645:0:5804:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1790784501 00010000:00010000:1.0:1790784502.341653:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000085f6a75c/0x2c3a1e2a079d4422 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352c2 expref: 9 pid: 6669 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.341671:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000085f6a75c/0x2c3a1e2a079d4422 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352c2 expref: 9 pid: 6669 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.341699:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085f6a75c/0x2c3a1e2a079d4422 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352c2 expref: 9 pid: 6669 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.341721:0:5804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790784502.341726:0:5804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790784502.341732:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000810546d4/0x2c3a1e2a079d4461 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.341743:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000810546d4/0x2c3a1e2a079d4461 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.341790:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790784502.341859:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d303b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:2352:x1877773344922240:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 301us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784502.341868:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 77 00010000:00010000:3.0:1790784502.342223:0:8181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000810546d4/0x2c3a1e2a079d4461 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.342235:0:8181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000810546d4/0x2c3a1e2a079d4461 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.342465:0:8181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000810546d4/0x2c3a1e2a079d4461 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.342475:0:8181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000810546d4/0x2c3a1e2a079d4461 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.342484:0:8181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000810546d4/0x2c3a1e2a079d4461 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.342491:0:8181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2f000 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:3.0:1790784502.342496:0:8181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000810546d4/0x2c3a1e2a079d4461 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.342505:0:8181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000810546d4/0x2c3a1e2a079d4461 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.342537:0:8181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000810546d4/0x2c3a1e2a079d4461 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.342544:0:8181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000810546d4/0x2c3a1e2a079d4461 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784502.342624:0:8181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d566d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2351:x1877773344921984:12345-192.168.206.32@tcp:1:lfs.0 Request processed in 17614us (18729us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784502.342634:0:8181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 61 00000100:00100000:0.0:1790784502.348194:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784502.348328:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344922496 00000100:00100000:1.0:1790784502.348341:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344922496 00000100:00100000:1.0:1790784502.348451:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 56 00000100:00100000:1.0:1790784502.348463:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc15850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+43:11571:x1877773344922496:12345-192.168.206.32@tcp:35:lfs.0 00000004:00010000:1.0:1790784502.348549:0:5822:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d4453 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352d7 expref: 43 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790784502.348914:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1790784502.348967:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:1.0:1790784502.349567:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:1.0:1790784502.349800:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4468 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.349820:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d440d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352b4 expref: 47 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.349894:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4468 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.349945:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d440d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352b4 expref: 47 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.349964:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d440d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352b4 expref: 47 pid: 5818 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784502.349981:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7e5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5822:1877773359590272:192.168.206.32@tcp:104: 00000100:00100000:1.0:1790784502.350097:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff945913122cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790784502.352669:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7e5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5822:1877773359590272:192.168.206.32@tcp:104: 00010000:00010000:1.0:1790784502.352726:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4468 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784502.356355:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784502.356860:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344922624 00000100:00100000:3.0:1790784502.356874:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344922624 00010000:00010000:3.0:1790784502.356933:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d440d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352b4 expref: 48 pid: 5818 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784502.356985:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 78 00000100:00100000:3.0:1790784502.356999:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fbbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+48:2351:x1877773344922624:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790784502.357020:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784502.357028:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d440d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352b4 expref: 48 pid: 5818 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.357043:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d440d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352b4 expref: 48 pid: 5818 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.357072:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d440d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352b4 expref: 48 pid: 5818 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.357115:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff945903af2a00) 00010000:00010000:3.0:1790784502.357121:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4468 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.357131:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4468 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.357140:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4468 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.357191:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790784502.357266:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fbbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+47:2351:x1877773344922624:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 270us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784502.357275:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 78 00010000:00010000:0.0:1790784502.357799:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4468 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.357811:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4468 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790784502.357980:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:0.0:1790784502.358260:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1790784502.358759:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593fbb8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5822:1877773359590400:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790784502.358839:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784502.358881:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593f57f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790784502.359827:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359590400 00000100:00100000:3.0:1790784502.359852:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359590400 00000100:00100000:3.0:1790784502.359964:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790784502.359976:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fbba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5822:x1877773359590400:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790784502.360118:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fbba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5822:x1877773359590400:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 144us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784502.360127:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1790784502.360219:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790784502.360350:0:5822:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1790784502.360358:0:5822:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:2.0:1790784502.360424:0:5822:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94592d717800, transno 4294967307 00000100:00100000:2.0:1790784502.360443:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593fbb8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5822:1877773359590400:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1790784502.361019:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1790784502.361121:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d567480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5822:1877773359590528:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790784502.361188:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784502.361229:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff945904fd7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790784502.361474:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359590528 00000100:00100000:1.0:1790784502.361481:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359590528 00000100:00100000:1.0:1790784502.361517:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790784502.361524:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5822:x1877773359590528:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790784502.361735:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5822:x1877773359590528:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 211us (547us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1790784502.361743:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790784502.362032:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d567480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5822:1877773359590528:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1790784502.362098:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1790784502.362148:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4468 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.362160:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4468 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.364076:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4468 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.364095:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030e00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784502.364101:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4468 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.364112:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4468 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.364134:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff945903af2a00) 00010000:00010000:2.0:1790784502.364137:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1790784502.364143:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4468 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.364150:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4468 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790784502.364445:0:5822:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1790784502.367861:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1790784502.367892:0:5822:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 336517515881ns, next at 337517508285ns, rc = 0 00000001:00080000:2.0:1790784502.367911:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1790784502.368000:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff945903af2a00) 00010000:00010000:2.0:1790784502.368005:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790784502.368021:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d4453 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352d7 expref: 51 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784502.368198:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc15850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+50:11571:x1877773344922496:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 19736us (20031us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1790784502.368209:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 56 00000020:00080000:2.0:1790784502.368216:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1790784502.376775:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784502.376935:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344922752 00000100:00100000:1.0:1790784502.376948:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344922752 00000100:00100000:1.0:1790784502.377027:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 202 00000100:00100000:1.0:1790784502.377039:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fbb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+50:11571:x1877773344922752:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:1.0:1790784502.377074:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784502.377102:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d446f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381352de expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.377183:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d446f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352de expref: 51 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.377202:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d446f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352de expref: 51 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.377226:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94590345d700) 00010000:00010000:1.0:1790784502.377229:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790784502.377250:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945900030c00, rc 0) 00000100:00100000:1.0:1790784502.377330:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fbb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+51:11571:x1877773344922752:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 294us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784502.377337:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 202 00000100:00100000:1.0:1790784502.383748:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784502.383925:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344923008 00000100:00100000:0.0:1790784502.383938:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344923008 00000100:00100000:0.0:1790784502.384009:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 57 00000100:00100000:0.0:1790784502.384023:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+51:11571:x1877773344923008:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:0.0:1790784502.384916:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+52:11571:x1877773344923008:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 889us (1176us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1790784502.384928:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 57 00000100:00100000:3.0:1790784502.488857:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784502.489039:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344923136 00000100:00100000:1.0:1790784502.489056:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344923136 00000100:00100000:1.0:1790784502.489145:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 203 00000100:00100000:1.0:1790784502.489159:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+52:11581:x1877773344923136:12345-192.168.206.32@tcp:34:lfs.0 00010000:00010000:1.0:1790784502.489273:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4476 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.489295:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4476 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.489309:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4476 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.489326:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d447d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.489334:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d447d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.489341:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d447d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.490117:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4484 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.490131:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4484 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.490142:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4484 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790784502.490206:0:9249:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4484 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.490224:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4476 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.490232:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4476 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.490259:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4476 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.490265:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784502.490269:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4476 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.490279:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4476 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.490294:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94590345dc00) 00010000:00010000:2.0:1790784502.490298:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784502.490303:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4476 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.490309:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4476 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.490329:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d447d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.490336:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d447d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.490342:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d447d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.490347:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900031c00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784502.490350:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d447d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.490366:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d447d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.490422:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94590345d600) 00010000:00010000:2.0:1790784502.490425:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784502.490428:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d447d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.490433:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d447d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.490453:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4484 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.490459:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4484 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.490465:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4484 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.490471:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74e00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784502.490473:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4484 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.490479:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4484 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.490486:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94590345d700) 00010000:00010000:2.0:1790784502.490488:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784502.490490:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4484 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.490508:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4484 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784502.490633:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+52:11581:x1877773344923136:12345-192.168.206.32@tcp:34:lfs.0 Request processed in 1473us (1800us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784502.490645:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 203 00000100:00100000:3.0:1790784502.528847:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784502.529124:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344923392 00000100:00100000:1.0:1790784502.529139:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344923392 00000100:00100000:1.0:1790784502.529226:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 204 00000100:00100000:1.0:1790784502.529250:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+52:11584:x1877773344923392:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:1.0:1790784502.529299:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784502.529326:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d448b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381352e5 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.529475:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4492 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.529494:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4492 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.529508:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4492 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.529524:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4499 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.529531:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.529537:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.530974:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d44a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.530996:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d44a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.531008:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d44a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784502.531021:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1790784502.531158:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4492 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.531436:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4492 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.531447:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4492 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.531453:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784502.531458:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4492 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.531479:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4492 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.531512:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94590345dc00) 00010000:00010000:2.0:1790784502.531516:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784502.531523:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4492 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.531531:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4492 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.531551:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.531557:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4499 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.531562:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4499 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.531567:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900031800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784502.531570:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4499 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.531575:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4499 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.531583:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94590345df00) 00010000:00010000:2.0:1790784502.531585:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784502.531588:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4499 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.531593:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4499 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.531686:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d448b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352e5 expref: 55 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.531703:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d44a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352e5 expref: 54 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.531711:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94590345d700) 00010000:00010000:2.0:1790784502.531713:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790784502.531716:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74e00, rc 0) 00000100:00100000:2.0:1790784502.531819:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+54:11584:x1877773344923392:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 2583us (2997us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1790784502.531829:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 204 00000100:00100000:0.0:1790784502.536575:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784502.536754:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344923520 00000100:00100000:2.0:1790784502.536769:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344923520 00000100:00100000:2.0:1790784502.537619:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 205 00000100:00100000:2.0:1790784502.537696:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591aa56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+54:11584:x1877773344923520:12345-192.168.206.32@tcp:54:lfs.0 00010000:00010000:2.0:1790784502.537797:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d44ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.537819:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d44ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.537834:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d44ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.537876:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d44ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.537907:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d44ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.537916:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d44ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.537923:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74c00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784502.537928:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d44ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.537937:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d44ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.537952:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94590345d700) 00010000:00010000:2.0:1790784502.537955:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790784502.537961:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d44ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.537968:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d44ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784502.538630:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591aa56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+54:11584:x1877773344923520:12345-192.168.206.32@tcp:54:lfs.0 Request processed in 993us (2066us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784502.538653:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 205 00000100:00100000:2.0:1790784502.541542:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784502.541641:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344923776 00000100:00100000:3.0:1790784502.541655:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344923776 00000100:00100000:3.0:1790784502.541725:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 58 00000100:00100000:3.0:1790784502.541737:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+54:11584:x1877773344923776:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:3.0:1790784502.542073:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+55:11584:x1877773344923776:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 337us (542us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1790784502.542081:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 58 00000100:00100000:3.0:1790784502.628606:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784502.629089:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344924032 00000100:00100000:2.0:1790784502.629103:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344924032 00000100:00100000:2.0:1790784502.629194:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 206 00000100:00100000:2.0:1790784502.629207:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d300380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+55:11594:x1877773344924032:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:2.0:1790784502.629266:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784502.629270:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790784502.629308:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d4430 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352c9 expref: 55 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.629336:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94590345dc00) 00010000:00010000:2.0:1790784502.629343:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790784502.629360:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d44b5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381352ec expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.629799:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d44bc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.629818:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d44a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352e5 expref: 55 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.629960:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d44bc lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.630005:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d44a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352e5 expref: 55 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.630021:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d44a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352e5 expref: 55 pid: 5820 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784502.630039:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d566a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5818:1877773359590656:192.168.206.32@tcp:104: 00000100:00100000:2.0:1790784502.630230:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592d511480 going to sleep for 11 seconds 00000100:00100000:1.0:1790784502.641726:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784502.641762:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d566a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5818:1877773359590656:192.168.206.32@tcp:104: 00010000:00010000:2.0:1790784502.641820:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d44bc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784502.641912:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344924160 00000100:00100000:3.0:1790784502.641926:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344924160 00010000:00010000:3.0:1790784502.641975:0:8480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d44a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352e5 expref: 56 pid: 5820 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784502.642026:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 79 00000100:00100000:3.0:1790784502.642038:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b0f9e8c2-ddb0-4027-babe-0b166585860c+56:2352:x1877773344924160:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790784502.642057:0:8480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784502.642064:0:8480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d44a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352e5 expref: 56 pid: 5820 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.642076:0:8480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d44a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352e5 expref: 56 pid: 5820 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.642103:0:8480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d44a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352e5 expref: 56 pid: 5820 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.642121:0:8480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94590345d700) 00010000:00010000:3.0:1790784502.642125:0:8480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d44bc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.642135:0:8480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d44bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.642155:0:8480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d44bc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.642352:0:8480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790784502.642477:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b0f9e8c2-ddb0-4027-babe-0b166585860c+55:2352:x1877773344924160:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 439us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784502.642486:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 79 00010000:00010000:2.0:1790784502.643787:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d44bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.643802:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d44bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784502.643889:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1790784502.644110:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d44b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352ec expref: 56 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.644135:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d44bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352ec expref: 55 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.644144:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94590345d700) 00010000:00010000:2.0:1790784502.644147:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790784502.644151:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74800, rc 0) 00000100:00100000:2.0:1790784502.644575:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d300380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+55:11594:x1877773344924032:12345-192.168.206.32@tcp:101:bash.0 Request processed in 15369us (15990us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1790784502.644584:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 206 00000100:00100000:1.0:1790784502.649614:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784502.649709:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344924416 00000100:00100000:0.0:1790784502.649722:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344924416 00000100:00100000:0.0:1790784502.649802:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 207 00000100:00100000:0.0:1790784502.649814:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+55:11594:x1877773344924416:12345-192.168.206.32@tcp:36:bash.0 00010000:00010000:0.0:1790784502.650183:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d44ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.650206:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d44ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.650221:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d44ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790784502.650299:0:9249:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:0.0:1790784502.650326:0:9249:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1640cc9 reply state 00000000492196c0 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d44ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784502.650337:0:9249:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790784502.651214:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+58:11594:x1877773344924416:12345-192.168.206.32@tcp:36:bash.0 Request processed in 1395us (1617us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1790784502.651226:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 207 00000020:00080000:1.0:1790784502.651233:0:9249:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790784502.655133:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784502.655680:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344924544 00000100:00100000:0.0:1790784502.655694:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344924544 00010000:00010000:1.0:1790784502.655751:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d44ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784502.655773:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 208 00000100:00100000:0.0:1790784502.655784:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+58:11594:x1877773344924544:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:1.0:1790784502.655785:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d44ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.655793:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d44ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.655799:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b0400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784502.655805:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d44ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.655814:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d44ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.655814:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784502.655837:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d44d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381352f3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.655896:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94590345d700) 00010000:00010000:1.0:1790784502.655901:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784502.655908:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d44ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.655914:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d44ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.655960:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d44d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.655975:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d44bc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352ec expref: 58 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.656000:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d44d8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.656055:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d44bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352ec expref: 58 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.656073:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d44bc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352ec expref: 58 pid: 5818 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784502.656090:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5820:1877773359590784:192.168.206.32@tcp:104: 00000100:00100000:0.0:1790784502.656266:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593f57fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1790784502.659154:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784502.659348:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5820:1877773359590784:192.168.206.32@tcp:104: 00010000:00010000:0.0:1790784502.659431:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d44d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784502.659690:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344924672 00000100:00100000:1.0:1790784502.659699:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344924672 00010000:00010000:1.0:1790784502.659748:0:8421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d44bc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352ec expref: 59 pid: 5818 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784502.659840:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 80 00000100:00100000:1.0:1790784502.659851:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d302300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+59:2351:x1877773344924672:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790784502.659872:0:8421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784502.659907:0:8421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d44bc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352ec expref: 59 pid: 5818 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.659921:0:8421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d44bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352ec expref: 59 pid: 5818 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.659949:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74800/0x2c3a1e2a079d44bc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352ec expref: 59 pid: 5818 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.659969:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94590345d700) 00010000:00010000:1.0:1790784502.659975:0:8421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d44d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.659986:0:8421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d44d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.659994:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d44d8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.660026:0:8421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790784502.660100:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d302300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+58:2351:x1877773344924672:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 250us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784502.660108:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 80 00010000:00010000:0.0:1790784502.660167:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d44d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.660176:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d44d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790784502.660246:0:5820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1790784502.660254:0:5820:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790784502.660279:0:5820:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d44d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.660316:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d44d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352f3 expref: 58 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.660351:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d44d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352f3 expref: 57 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.660359:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94590345d700) 00010000:00010000:0.0:1790784502.660362:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790784502.660364:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b1800, rc 0) 00000100:00100000:0.0:1790784502.660411:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+57:11594:x1877773344924544:12345-192.168.206.32@tcp:101:bash.0 Request processed in 4630us (5293us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784502.660418:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 208 00000100:00100000:3.0:1790784502.663319:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784502.663708:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344924928 00000100:00100000:2.0:1790784502.663723:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344924928 00000100:00100000:2.0:1790784502.663831:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 59 00000100:00100000:2.0:1790784502.663844:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+57:11594:x1877773344924928:12345-192.168.206.32@tcp:35:bash.0 00000100:00100000:2.0:1790784502.664280:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+58:11594:x1877773344924928:12345-192.168.206.32@tcp:35:bash.0 Request processed in 436us (973us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1790784502.664311:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 59 00000100:00100000:2.0:1790784502.734463:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784502.734660:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344925056 00000100:00100000:0.0:1790784502.734675:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344925056 00000100:00100000:0.0:1790784502.734755:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 209 00000100:00100000:0.0:1790784502.734768:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+58:11600:x1877773344925056:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:0.0:1790784502.734802:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784502.734839:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d44df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381352fa expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.734927:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d44e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.734946:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d44e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.734959:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d44e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790784502.735003:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1790784502.735023:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790784502.735048:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d44e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.735079:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d44df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352fa expref: 60 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.735100:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d44e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352fa expref: 59 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.735110:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94590345dc00) 00010000:00010000:0.0:1790784502.735114:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790784502.735119:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b1000, rc 0) 00000100:00100000:0.0:1790784502.735202:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+59:11600:x1877773344925056:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 437us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784502.735209:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 209 00000100:00100000:2.0:1790784502.740622:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784502.740793:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344925184 00000100:00100000:3.0:1790784502.740807:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344925184 00000100:00100000:3.0:1790784502.740900:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 210 00000100:00100000:3.0:1790784502.740911:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+59:11600:x1877773344925184:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:3.0:1790784502.740939:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784502.740966:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f000/0x2c3a1e2a079d44ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135301 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.741049:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d44f4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.741066:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d44f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.741079:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d44f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.741094:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d44fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.741120:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d44fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.741127:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d44fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.741258:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f200/0x2c3a1e2a079d4502 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.741269:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f200/0x2c3a1e2a079d4502 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.741288:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f200/0x2c3a1e2a079d4502 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790784502.741337:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1790784502.741342:0:5818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790784502.741367:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f200/0x2c3a1e2a079d4502 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.741429:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f200/0x2c3a1e2a079d4502 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.741439:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d44f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.741447:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d44f4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.741454:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d44f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.741472:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2f400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784502.741477:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d44f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.741487:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d44f4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.741501:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94590345dc00) 00010000:00010000:3.0:1790784502.741504:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784502.741510:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d44f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.741517:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d44f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.741534:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d44fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.741540:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d44fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.741547:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d44fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.741551:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2e800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784502.741554:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d44fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.741561:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d44fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.741581:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94592012a500) 00010000:00010000:3.0:1790784502.741584:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784502.741587:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d44fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.741602:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d44fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.741847:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f000/0x2c3a1e2a079d44ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135301 expref: 61 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.741866:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f200/0x2c3a1e2a079d4502 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135301 expref: 60 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.741873:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94590345d700) 00010000:00010000:3.0:1790784502.741876:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790784502.741878:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945802d2f200, rc 0) 00000100:00100000:3.0:1790784502.742118:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+60:11600:x1877773344925184:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 1204us (1516us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784502.742128:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 210 00000100:00100000:3.0:1790784502.748506:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784502.748649:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344925440 00000100:00100000:1.0:1790784502.748662:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344925440 00000100:00100000:1.0:1790784502.748743:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 211 00000100:00100000:1.0:1790784502.748757:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+60:11600:x1877773344925440:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:1.0:1790784502.748787:0:9249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784502.748815:0:9249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4509 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135308 expref: -99 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.748981:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4510 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.748999:0:9249:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d44d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352f3 expref: 61 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.749007:0:9249:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f200/0x2c3a1e2a079d4502 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135301 expref: 61 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.749016:0:9249:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4510 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.749064:0:9249:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f200/0x2c3a1e2a079d4502 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135301 expref: 61 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.749777:0:9249:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f200/0x2c3a1e2a079d4502 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135301 expref: 61 pid: 5818 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784502.749798:0:9249:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9249:1877773359590912:192.168.206.32@tcp:104: 00010000:00010000:1.0:1790784502.750022:0:9249:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d44d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352f3 expref: 61 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.750034:0:9249:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d44d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352f3 expref: 61 pid: 5820 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784502.750045:0:9249:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7e4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9249:1877773359591040:192.168.206.32@tcp:104: 00000100:00100000:1.0:1790784502.750088:0:9249:0:(client.c:2716:ptlrpc_set_wait()) set ffff945913122cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790784502.750185:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784502.750457:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344925568 00000100:00100000:1.0:1790784502.750534:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344925568 00010000:00010000:1.0:1790784502.750575:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f200/0x2c3a1e2a079d4502 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135301 expref: 62 pid: 5818 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784502.750636:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 81 00000100:00100000:1.0:1790784502.750646:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d567b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+62:2352:x1877773344925568:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790784502.750660:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784502.750667:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f200/0x2c3a1e2a079d4502 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135301 expref: 62 pid: 5818 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.750681:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f200/0x2c3a1e2a079d4502 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135301 expref: 62 pid: 5818 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.750706:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94590345d700) 00010000:00010000:1.0:1790784502.750712:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4510 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.750722:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4510 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.750729:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790784502.750778:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d567b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+62:2352:x1877773344925568:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 133us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784502.750788:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 81 00010000:00010000:1.0:1790784502.755656:0:9249:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.32@tcp) returned -22 from blocking AST (req@00000000aab3f3ec x1877773359590912) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f200/0x2c3a1e2a079d4502 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135301 expref: 61 pid: 5818 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.755713:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f200/0x2c3a1e2a079d4502 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135301 expref: 61 pid: 5818 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784502.755738:0:9249:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9249:1877773359590912:192.168.206.32@tcp:104: 00000100:00100000:1.0:1790784502.755758:0:9249:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7e4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9249:1877773359591040:192.168.206.32@tcp:104: 00010000:00010000:1.0:1790784502.755787:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94590345d700) 00010000:00010000:1.0:1790784502.755794:0:9249:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4510 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.755805:0:9249:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4510 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.755816:0:9249:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4510 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784502.755990:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784502.756046:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344925696 00000100:00100000:3.0:1790784502.756056:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344925696 00010000:00010000:3.0:1790784502.756107:0:8480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d44d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352f3 expref: 61 pid: 5820 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784502.756161:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 82 00000100:00100000:3.0:1790784502.756186:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905105050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b0f9e8c2-ddb0-4027-babe-0b166585860c+61:2352:x1877773344925696:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790784502.756214:0:8480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784502.756221:0:8480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d44d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352f3 expref: 61 pid: 5820 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.756233:0:8480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d44d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352f3 expref: 61 pid: 5820 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.756257:0:8480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d44d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381352f3 expref: 61 pid: 5820 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.756272:0:8480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94590345d700) 00010000:00010000:3.0:1790784502.756484:0:8480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4510 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.756495:0:8480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4510 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784502.756504:0:8480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4510 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784502.756612:0:8480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790784502.756630:0:9249:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4510 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.756639:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4510 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790784502.756667:0:9249:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000100:00100000:2.0:1790784502.756700:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905105050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b0f9e8c2-ddb0-4027-babe-0b166585860c+60:2352:x1877773344925696:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 528us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784502.756708:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 82 00010000:00010000:1.0:1790784502.756862:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900031c00/0x2c3a1e2a079d4509 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135308 expref: 61 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.756896:0:9249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4510 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135308 expref: 60 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.756917:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94590345d700) 00010000:00010000:1.0:1790784502.756920:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790784502.756923:0:9249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945900031800, rc 0) 00000100:00100000:1.0:1790784502.756951:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+60:11600:x1877773344925440:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 8198us (8460us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1790784502.756958:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 211 00000100:00100000:3.0:1790784502.760768:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784502.760864:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344925952 00000100:00100000:1.0:1790784502.760879:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344925952 00000100:00100000:1.0:1790784502.760969:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 15 00000100:00100000:1.0:1790784502.760981:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d714380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+60:11600:x1877773344925952:12345-192.168.206.32@tcp:103:lfs.0 00010000:00010000:1.0:1790784502.761000:0:8421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784502.761031:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d446f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352de expref: 60 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784502.761056:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94590345d700) 00010000:00010000:1.0:1790784502.761063:0:8421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790784502.761140:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d714380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+59:11600:x1877773344925952:12345-192.168.206.32@tcp:103:lfs.0 Request processed in 161us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784502.761148:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 15 00000100:00100000:3.0:1790784502.763878:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784502.764042:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344926080 00000100:00100000:0.0:1790784502.764056:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344926080 00000100:00100000:0.0:1790784502.764129:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 212 00000100:00100000:0.0:1790784502.764140:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+59:11600:x1877773344926080:12345-192.168.206.32@tcp:58:lfs.0 00010000:00010000:0.0:1790784502.764686:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d451e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.764707:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d451e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.764721:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d451e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790784502.765365:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1790784502.765671:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+59:11600:x1877773344926080:12345-192.168.206.32@tcp:58:lfs.0 Request processed in 1529us (1804us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784502.765684:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 212 00000100:00100000:2.0:1790784502.769139:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784502.769526:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344926208 00000100:00100000:0.0:1790784502.769541:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344926208 00000100:00100000:0.0:1790784502.769666:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 213 00000100:00100000:0.0:1790784502.769679:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+59:11600:x1877773344926208:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:0.0:1790784502.769706:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784502.769734:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d4525 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813530f expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.769809:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d451e lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.769821:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d4525 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813530f expref: 60 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.769858:0:5819:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d451e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.769873:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d4525 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813530f expref: 60 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.769890:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94590345d700) 00010000:00010000:0.0:1790784502.769894:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790784502.769898:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d4525 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813530f expref: 60 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784502.769907:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b1a00, rc 0) 00000100:00100000:0.0:1790784502.770010:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+60:11600:x1877773344926208:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 333us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784502.770017:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 213 00000100:00100000:2.0:1790784503.226824:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593d7e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359591168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790784503.226888:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784503.227059:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359591168 00000100:00100000:0.0:1790784503.227075:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359591168 00000100:00100000:0.0:1790784503.227150:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790784503.227164:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d567b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1877773359591168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790784503.227197:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790784503.227563:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3280:1877773359591296:0@lo:400:kworker.0 00000100:00100000:3.0:1790784503.227610:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1877773359591424:0@lo:400:kworker.0 00000100:00100000:3.0:1790784503.227739:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784503.227775:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790784503.227785:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459349f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359591552:0@lo:400:kworker.0 00000100:00100000:0.0:1790784503.227798:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d567b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1877773359591168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 636us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784503.227810:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790784503.227817:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593d7e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359591168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790784503.227819:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784503.227852:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359591424 00000100:00100000:0.0:1790784503.227859:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359591424 00000100:00100000:3.0:1790784503.227864:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359591552 00000100:00100000:2.0:1790784503.227864:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459349f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1877773359591680:0@lo:400:kworker.0 00000100:00100000:3.0:1790784503.227891:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359591552 00000100:00080000:3.0:1790784503.227923:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790784503.227924:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784503.227964:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359591680 00000100:00100000:2.0:1790784503.227968:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790784503.227971:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359591680 00000100:00100000:2.0:1790784503.227979:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459349f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359591808:0@lo:400:kworker.0 00000100:00080000:3.0:1790784503.227996:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790784503.228016:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784503.228026:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1790784503.228041:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459349f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1877773359591424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784503.228067:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359591808 00000100:00100000:2.0:1790784503.228075:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359591808 00000100:00100000:3.0:1790784503.228103:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459349f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1877773359591424:12345-0@lo:400:kworker.0 Request processed in 68us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784503.228113:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1790784503.228148:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790784503.228158:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d565f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1877773359591808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784503.228207:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d565f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1877773359591808:12345-0@lo:400:kworker.0 Request processed in 50us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784503.228213:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790784503.228270:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459349f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359591808:0@lo:400:kworker.0 00000100:00100000:2.0:1790784503.228308:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790784503.228316:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459349f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1877773359591552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784503.228360:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459349f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1877773359591552:12345-0@lo:400:kworker.0 Request processed in 46us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784503.228366:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790784503.228396:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790784503.228402:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1877773359591680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784503.228430:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1877773359591680:12345-0@lo:400:kworker.0 Request processed in 28us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784503.228436:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790784503.228463:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459349f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1877773359591680:0@lo:400:kworker.0 00000100:00080000:2.0:1790784503.228485:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790784503.236052:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1877773359591424:0@lo:400:kworker.0 00000100:00100000:3.0:1790784503.236099:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459349f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359591552:0@lo:400:kworker.0 00000100:00100000:1.0:1790784503.240192:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784503.241631:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359591296 00000100:00100000:3.0:1790784503.241649:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359591296 00000100:00100000:3.0:1790784503.241740:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1790784503.241752:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3280:x1877773359591296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784503.241873:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3280:x1877773359591296:12345-0@lo:400:kworker.0 Request processed in 124us (1694us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784503.241881:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1790784503.244470:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3280:1877773359591296:0@lo:400:kworker.0 00010000:00010000:2.0:1790784503.291255:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790784503.419132:0:11656:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790784503.419144:0:11656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790784503.420154:0:11656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1790784503.420167:0:11656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790784503.420911:0:11656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d567100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11656:1877773359591936:192.168.206.32@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790784503.422846:0:11656:0:(client.c:2716:ptlrpc_set_wait()) set ffff945935eae3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790784503.439444:0:11656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d567100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11656:1877773359591936:192.168.206.32@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790784503.447085:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784503.448222:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344926336 00000100:00100000:2.0:1790784503.448242:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344926336 00000100:00080000:3.0:1790784503.448405:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790784503.448624:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 214 00000100:00100000:2.0:1790784503.448648:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459349f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+60:11601:x1877773344926336:12345-192.168.206.32@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790784503.448690:0:5818:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790784503.448861:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459349f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+60:11601:x1877773344926336:12345-192.168.206.32@tcp:53:lhsmtool_posix.0 Request processed in 217us (1788us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784503.448870:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 214 00000100:00100000:3.0:1790784503.456640:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784503.456765:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344926464 00000100:00100000:0.0:1790784503.456777:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344926464 00000100:00100000:0.0:1790784503.456856:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 215 00000100:00100000:0.0:1790784503.456869:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459349f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+60:11601:x1877773344926464:12345-192.168.206.32@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1790784503.456979:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d452c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.457000:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d452c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.457017:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d452c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.457224:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4533 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.457247:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4533 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.457522:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4533 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.457639:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d453a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.457649:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d453a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.457657:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d453a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790784503.457701:0:9249:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1790784503.457706:0:9249:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790784503.457720:0:9249:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d453a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.458048:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d452c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.458057:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d452c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.458064:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d452c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.458071:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b0c00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784503.458076:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d452c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.458205:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d452c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.458229:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94592012a400) 00010000:00010000:0.0:1790784503.458232:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784503.458237:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d452c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.458244:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d452c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.458498:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4533 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.458506:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4533 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.458512:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4533 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.458517:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b0200 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784503.458521:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4533 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.458527:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4533 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.458535:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff945903a23e00) 00010000:00010000:0.0:1790784503.458618:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784503.458624:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4533 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.458631:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4533 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.458660:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d453a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.458666:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d453a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.458672:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d453a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.458678:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b1800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784503.458680:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d453a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.458687:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d453a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.458694:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94590345d700) 00010000:00010000:0.0:1790784503.458697:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784503.458700:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d453a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.458706:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d453a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784503.458911:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459349f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+60:11601:x1877773344926464:12345-192.168.206.32@tcp:34:lhsmtool_posix.0 Request processed in 2041us (2288us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784503.458922:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 215 00000100:00100000:3.0:1790784503.475834:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784503.482707:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344926720 00000100:00100000:0.0:1790784503.482724:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344926720 00000100:00100000:0.0:1790784503.483195:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 216 00000100:00100000:0.0:1790784503.483227:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459349f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+60:11601:x1877773344926720:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790784503.483250:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784503.483286:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d4541 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135316 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.483421:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4548 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.483437:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4548 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.483449:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4548 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790784503.483461:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1790784503.483554:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4548 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.483562:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4548 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.483569:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4548 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.483576:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b0200 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784503.483580:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4548 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.483588:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4548 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.483621:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94590345d700) 00010000:00010000:0.0:1790784503.483630:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790784503.483636:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4548 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.483643:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4548 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.483687:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d4541 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135316 expref: 62 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.483708:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94592012a400) 00010000:00010000:0.0:1790784503.483710:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790784503.483714:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d4541 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135316 expref: 62 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.483725:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b1800, rc 0) 00000100:00100000:0.0:1790784503.483938:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459349f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+61:11601:x1877773344926720:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 713us (8128us total) trans 4294967504 rc 301/301 00000100:00100000:0.0:1790784503.483945:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 216 00000100:00100000:3.0:1790784503.497198:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784503.501602:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344926848 00000100:00100000:2.0:1790784503.501630:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344926848 00000100:00100000:2.0:1790784503.501728:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 217 00000100:00100000:2.0:1790784503.501740:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+61:11601:x1877773344926848:12345-192.168.206.32@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790784503.501792:0:5818:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790784503.501941:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+61:11601:x1877773344926848:12345-192.168.206.32@tcp:53:lhsmtool_posix.0 Request processed in 202us (4768us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784503.501961:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 217 00000100:00100000:3.0:1790784503.506568:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784503.507125:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344927104 00000100:00100000:0.0:1790784503.507139:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344927104 00000100:00100000:0.0:1790784503.507228:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 218 00000100:00100000:0.0:1790784503.507241:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+61:11601:x1877773344927104:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790784503.507270:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784503.507274:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790784503.507311:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d44e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381352fa expref: 61 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.507339:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94590345dc00) 00010000:00010000:0.0:1790784503.507356:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790784503.507424:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d4556 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813531d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790784503.507971:0:5820:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:0.0:1790784503.508226:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d455d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.508242:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d455d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.508255:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d455d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.508320:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d4556 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813531d expref: 63 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.508343:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d455d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813531d expref: 62 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.508352:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff945903a23e00) 00010000:00010000:0.0:1790784503.508355:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790784503.508358:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b0200, rc 0) 00000100:00100000:0.0:1790784503.508488:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+62:11601:x1877773344927104:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 1249us (1933us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1790784503.508496:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 218 00000100:00100000:3.0:1790784503.516673:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784503.516895:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344927360 00000100:00100000:2.0:1790784503.516908:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344927360 00000100:00100000:2.0:1790784503.516990:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 219 00000100:00100000:2.0:1790784503.517002:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+62:11601:x1877773344927360:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790784503.517080:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784503.517129:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d455d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813531d expref: 62 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.517150:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff945903a23e00) 00010000:00010000:2.0:1790784503.517163:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790784503.517573:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d456b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.517610:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d456b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.517623:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d456b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.517671:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d4572 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x37c5828b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.517679:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d4572 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x37c5828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.517686:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d4572 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x37c5828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.517768:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d456b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.517776:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d456b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.517783:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d456b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.517790:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74200 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784503.517795:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d456b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.517804:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d456b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.517814:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94590345dc00) 00010000:00010000:2.0:1790784503.517817:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784503.517822:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d456b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.517829:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d456b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.517849:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d4572 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x37c5828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.517856:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d4572 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x37c5828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.517861:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d4572 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x37c5828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.517866:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75600 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784503.517869:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d4572 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x37c5828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.517875:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d4572 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x37c5828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.517882:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x37c5828b (ffff945903af2a00) 00010000:00010000:2.0:1790784503.517884:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784503.517887:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d4572 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x37c5828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.517893:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75600/0x2c3a1e2a079d4572 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x37c5828b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784503.518303:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+61:11601:x1877773344927360:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 Request processed in 1298us (1640us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790784503.518312:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 219 00000100:00100000:3.0:1790784503.523312:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784503.526147:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344927488 00000100:00100000:0.0:1790784503.526179:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344927488 00000100:00100000:0.0:1790784503.526318:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 220 00000100:00100000:0.0:1790784503.526331:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+61:11601:x1877773344927488:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790784503.526400:0:5820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784503.526432:0:5820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d4579 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135324 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.526478:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d4580 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.526494:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d4580 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.526508:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d4580 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.527065:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d4579 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135324 expref: 63 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.527091:0:5820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d4580 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135324 expref: 62 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.527112:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff945903a23a00) 00010000:00010000:0.0:1790784503.527115:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790784503.527119:0:5820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b1000, rc 0) 00000100:00100000:1.0:1790784503.529026:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+62:11601:x1877773344927488:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 2682us (5712us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784503.529059:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 220 00000100:00100000:3.0:1790784503.533850:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784503.534147:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344927744 00000100:00100000:0.0:1790784503.534159:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344927744 00000100:00100000:0.0:1790784503.534249:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 221 00000100:00100000:0.0:1790784503.534261:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+62:11601:x1877773344927744:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790784503.534371:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d4587 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.534457:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d4587 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.534471:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d4587 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790784503.534788:0:9249:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1790784503.534799:0:9249:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 337684423443ns, next at 338684420818ns, rc = 0 00000004:00010000:0.0:1790784503.534903:0:9249:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000250844e5 reply state 000000009ec3e7ed transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d4587 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784503.534913:0:9249:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790784503.535043:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+64:11601:x1877773344927744:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 Request processed in 783us (1204us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1790784503.535051:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 221 00010000:00010000:2.0:1790784503.541230:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d4587 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784503.541233:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00010000:00010000:2.0:1790784503.541266:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d4587 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.541275:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d4587 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.541282:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b1800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784503.541288:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d4587 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.541296:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d4587 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.541316:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff945903a23a00) 00010000:00010000:2.0:1790784503.541319:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790784503.541326:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d4587 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.541333:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1800/0x2c3a1e2a079d4587 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784503.541680:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344927872 00000100:00100000:0.0:1790784503.541693:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344927872 00000100:00100000:0.0:1790784503.541762:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 222 00000100:00100000:0.0:1790784503.541773:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+63:11601:x1877773344927872:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790784503.541806:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784503.541840:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d458e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813532b expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.541917:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d458e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813532b expref: 64 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.541934:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d458e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813532b expref: 64 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.541984:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff945903a23a00) 00010000:00010000:0.0:1790784503.541988:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790784503.541991:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b0c00, rc 0) 00000100:00100000:0.0:1790784503.542064:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+64:11601:x1877773344927872:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 292us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784503.542071:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 222 00000100:00100000:3.0:1790784503.567114:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784503.567486:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344928000 00000100:00100000:0.0:1790784503.567499:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344928000 00000100:00100000:0.0:1790784503.567618:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 62 00000100:00100000:0.0:1790784503.567630:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+9:2351:x1877773344928000:12345-192.168.206.32@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1790784503.568032:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+10:2351:x1877773344928000:12345-192.168.206.32@tcp:2:lhsmtool_posix.0 Request processed in 402us (933us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1790784503.568041:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 62 00000100:00080000:3.0:1790784503.568926:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790784503.574535:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784503.574821:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344928256 00000100:00100000:0.0:1790784503.574834:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344928256 00000100:00100000:0.0:1790784503.574905:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 60 00000100:00100000:0.0:1790784503.574918:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+64:11601:x1877773344928256:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790784503.575266:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+65:11601:x1877773344928256:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 Request processed in 349us (742us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1790784503.575275:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 60 00000100:00100000:2.0:1790784503.586069:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784503.586429:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344928512 00000100:00100000:3.0:1790784503.586444:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344928512 00000100:00100000:3.0:1790784503.586511:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 223 00000100:00100000:3.0:1790784503.586523:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+65:11601:x1877773344928512:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790784503.586698:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+65:11601:x1877773344928512:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 Request processed in 177us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784503.586707:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 223 00000100:00100000:3.0:1790784503.597459:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784503.597570:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344928640 00000100:00100000:0.0:1790784503.597600:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344928640 00000100:00100000:0.0:1790784503.597676:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 224 00000100:00100000:0.0:1790784503.597689:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+65:11601:x1877773344928640:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790784503.597732:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784503.597758:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d4595 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135332 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.597865:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d459c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.597883:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d459c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.597896:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d459c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790784503.597943:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790784503.598253:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d459c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.598292:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0400/0x2c3a1e2a079d4595 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135332 expref: 67 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.598313:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d459c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135332 expref: 66 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.598321:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff945903a23a00) 00010000:00010000:0.0:1790784503.598324:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790784503.598328:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b1c00, rc 0) 00000100:00100000:0.0:1790784503.600014:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+66:11601:x1877773344928640:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 2315us (2556us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784503.600029:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 224 00000100:00100000:1.0:1790784503.611732:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784503.612487:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344928768 00000100:00100000:2.0:1790784503.612501:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344928768 00000100:00100000:2.0:1790784503.612602:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 63 00000100:00100000:2.0:1790784503.612614:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+10:2352:x1877773344928768:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790784503.612806:0:6668:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784503.612835:0:6668:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3ef6bfb/0x2c3a1e2a079d45a3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135339 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790784503.612892:0:6668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abd33f7, blocks: 0x1 00010000:00010000:2.0:1790784503.612920:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=337s v=(0 0) 00010000:00010000:2.0:1790784503.612925:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790784503.612936:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3ef6bfb/0x2c3a1e2a079d45a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135339 expref: 11 pid: 6668 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.612970:0:6668:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d3ef6bfb/0x2c3a1e2a079d45a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135339 expref: 11 pid: 6668 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.612986:0:6668:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe75800, rc 0) 00000100:00100000:2.0:1790784503.613129:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+11:2352:x1877773344928768:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 517us (1411us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784503.613137:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 63 00000100:00100000:2.0:1790784503.631478:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784503.632306:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344929024 00000100:00100000:3.0:1790784503.632323:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344929024 00000100:00100000:3.0:1790784503.632444:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 225 00000100:00100000:3.0:1790784503.632457:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fbbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+66:11601:x1877773344929024:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790784503.633802:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fbbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+66:11601:x1877773344929024:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 Request processed in 1332us (2326us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784503.633818:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 225 00000100:00100000:3.0:1790784503.642568:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784503.648338:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344929152 00000100:00100000:0.0:1790784503.648360:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344929152 00000100:00100000:0.0:1790784503.648455:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 64 00000100:00100000:0.0:1790784503.648467:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+11:11601:x1877773344929152:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790784503.648491:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784503.648517:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d45aa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135340 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.648565:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d3ef6bfb/0x2c3a1e2a079d45a3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135339 expref: 12 pid: 6668 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.648576:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790784503.648596:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790784503.648603:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d45aa lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135340 expref: 12 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.649786:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d3ef6bfb/0x2c3a1e2a079d45a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135339 expref: 12 pid: 6668 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.649815:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d3ef6bfb/0x2c3a1e2a079d45a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135339 expref: 12 pid: 6668 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784503.649837:0:6670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6670:1877773359592064:192.168.206.32@tcp:104: 00000100:00100000:0.0:1790784503.650824:0:6670:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593f57f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790784503.662468:0:6670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6670:1877773359592064:192.168.206.32@tcp:104: 00010000:00010000:0.0:1790784503.662520:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d45aa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135340 expref: 12 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.662571:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b0400, rc 0) 00000100:00100000:0.0:1790784503.662682:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+12:11601:x1877773344929152:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 14217us (20128us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784503.662692:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 64 00000100:00100000:1.0:1790784503.663516:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784503.663976:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344929280 00000100:00100000:2.0:1790784503.663987:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344929280 00010000:00010000:2.0:1790784503.664041:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d3ef6bfb/0x2c3a1e2a079d45a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135339 expref: 12 pid: 6668 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784503.664104:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 83 00000100:00100000:2.0:1790784503.664115:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+12:2352:x1877773344929280:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790784503.664133:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784503.664179:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d3ef6bfb/0x2c3a1e2a079d45a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135339 expref: 12 pid: 6668 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.664215:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d3ef6bfb/0x2c3a1e2a079d45a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135339 expref: 12 pid: 6668 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.664244:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3ef6bfb/0x2c3a1e2a079d45a3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135339 expref: 12 pid: 6668 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.664263:0:5804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790784503.664268:0:5804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790784503.664277:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d45aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135340 expref: 11 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.664288:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d45aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135340 expref: 11 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.664338:0:5804:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d45aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135340 expref: 11 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784503.664355:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d303b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5804:1877773359592192:192.168.206.32@tcp:105: 00000100:00100000:2.0:1790784503.664485:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff945935eae3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790784503.674212:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784503.674461:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d303b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5804:1877773359592192:192.168.206.32@tcp:105: 00010000:00010000:1.0:1790784503.674495:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790784503.674577:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+11:2352:x1877773344929280:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 10463us (11066us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784503.674607:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 83 00000100:00100000:3.0:1790784503.675503:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344929408 00000100:00100000:3.0:1790784503.675516:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344929408 00002000:00100000:3.0:1790784503.675579:0:6675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff94592d302300 x1877773344929408/t0(0) o4->b0f9e8c2-ddb0-4027-babe-0b166585860c@192.168.206.32@tcp:14/0 lens 504/0 e 0 to 0 dl 1790784514 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790784503.675607:0:6675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94592d302300 with x1877773344929408 ext(0->12) 00002000:00010000:3.0:1790784503.675640:0:6675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94592d302300 00000100:00100000:3.0:1790784503.675681:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 6 00000100:00100000:3.0:1790784503.675692:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d302300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+11:2351:x1877773344929408:12345-192.168.206.32@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1790784503.676710:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d302300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+13:2351:x1877773344929408:12345-192.168.206.32@tcp:4:lhsmtool_posix.0 Request processed in 1011us (2504us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1790784503.676721:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 6 00002000:00100000:3.0:1790784503.676732:0:6675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff94592d302300 x1877773344929408/t4294967320(0) o4->b0f9e8c2-ddb0-4027-babe-0b166585860c@192.168.206.32@tcp:14/0 lens 504/448 e 0 to 0 dl 1790784514 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790784503.676741:0:6675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94592d302300 with x1877773344929408 ext(0->12) 00002000:00010000:3.0:1790784503.676747:0:6675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94592d302300 00000100:00100000:2.0:1790784503.686248:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784503.686479:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344929536 00000100:00100000:1.0:1790784503.686493:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344929536 00000100:00100000:1.0:1790784503.686573:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 226 00000100:00100000:1.0:1790784503.686601:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+66:11601:x1877773344929536:12345-192.168.206.32@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1790784503.743940:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790784503.744546:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359592320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790784503.745113:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784503.745417:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359592320 00000100:00100000:1.0:1790784503.745430:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359592320 00000100:00100000:1.0:1790784503.745551:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790784503.745565:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1877773359592320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790784503.745613:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790784503.745675:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1877773359592320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784503.745684:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790784503.746127:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359592320:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1790784503.805509:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:2.0:1790784503.805540:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:2.0:1790784503.805612:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:2.0:1790784503.805680:0:5841:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9459050c0480 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1790784503.805713:0:5841:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9459200f5300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9459050c0900 00000020:00080000:2.0:1790784503.805717:0:5841:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9459200f5a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94592d836400 00000004:00080000:2.0:1790784503.805765:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:2.0:1790784503.805789:0:5841:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945904fd7f00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1790784503.805792:0:5841:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94592a99fa00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945904fd7900 00000020:00080000:2.0:1790784503.805796:0:5841:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94592a99fb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94592d212000 00000020:00080000:2.0:1790784503.805808:0:5841:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:2.0:1790784503.806041:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459102e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359592448:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1790784503.806132:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784503.806228:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359592448 00000100:00100000:2.0:1790784503.806237:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359592448 00000020:00080000:0.0:1790784503.806296:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:2.0:1790784503.806300:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790784503.806314:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459102e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1877773359592448:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1790784503.806350:0:6669:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1790784503.806430:0:6669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6abd33f5, atime: 0x6abd33f6, ctime: 0x6abd33f5, blocks: 0x1 00010000:00010000:2.0:1790784503.806442:0:6669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009408529d/0x2c3a1e2a079d45b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.806462:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=337s v=(0 0) 00010000:00010000:2.0:1790784503.806468:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790784503.806475:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009408529d/0x2c3a1e2a079d45b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.806494:0:6669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009408529d/0x2c3a1e2a079d45b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.806521:0:6669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009408529d/0x2c3a1e2a079d45b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.806529:0:6669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009408529d/0x2c3a1e2a079d45b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.806553:0:6669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:0.0:1790784503.806746:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1790784503.807822:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359592704:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1790784503.807914:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784503.807960:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790784503.807967:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359592576:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790784503.807993:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784503.808605:0:8181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359592704 00000100:00100000:3.0:1790784503.808616:0:8181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359592704 00000100:00100000:3.0:1790784503.808656:0:8181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359592576 00000100:00100000:3.0:1790784503.808659:0:8181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359592576 00000100:00100000:3.0:1790784503.808689:0:8181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790784503.808699:0:8181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3280:x1877773359592704:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1790784503.808875:0:8181:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1790784503.808879:0:8181:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1790784503 00002000:00010000:3.0:1790784503.808881:0:8181:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790784503.808883:0:8181:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1790784503 -> 1790784503 00002000:00010000:3.0:1790784503.808886:0:8181:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1790784503.808954:0:8181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3280:x1877773359592704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 257us (1040us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1790784503.808963:0:8181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790784503.808981:0:8181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790784503.808987:0:8181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3280:x1877773359592576:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1790784503.809004:0:8181:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:3.0:1790784503.809024:0:8181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d45b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784503.809049:0:8181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3d350b8/0x2c3a1e2a079d4373 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813529f expref: 12 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784503.809059:0:8181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1790784503.809064:0:8181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790784503.809070:0:8181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d45b8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784503.809105:0:8181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e3d350b8/0x2c3a1e2a079d4373 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.32@tcp remote: 0x394e0d883813529f expref: 12 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784503.809122:0:8181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e3d350b8/0x2c3a1e2a079d4373 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.32@tcp remote: 0x394e0d883813529f expref: 12 pid: 6669 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784503.809136:0:8181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8181:1877773359592832:192.168.206.32@tcp:104: 00000100:00100000:3.0:1790784503.809225:0:8181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459050c0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790784503.809577:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459102e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3282:x1877773359592448:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3263us (3442us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1790784503.809586:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:2.0:1790784503.809628:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790784503.809636:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009408529d/0x2c3a1e2a079d45b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.809646:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74c00 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:2.0:1790784503.809651:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009408529d/0x2c3a1e2a079d45b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790784503.809792:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94592d9cf800/2, rc 0, transno 4294967321 00000100:00100000:1.0:1790784503.809800:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359592704:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1790784503.809846:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009408529d/0x2c3a1e2a079d45b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.809869:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009408529d/0x2c3a1e2a079d45b1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.809877:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009408529d/0x2c3a1e2a079d45b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.812056:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784503.812060:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784503.812063:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784503.812253:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+20:11601:x1877773344929536:12345-192.168.206.32@tcp:44:lhsmtool_posix.0 Request processed in 125663us (126012us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784503.812265:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 226 00000004:00080000:3.0:1790784503.812736:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9459102e8700/2, rc 0, transno 4294967310 00000100:00100000:3.0:1790784503.812765:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459102e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359592448:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790784503.813047:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784503.813145:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344929664 00000100:00100000:1.0:1790784503.813154:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344929664 00010000:00010000:1.0:1790784503.813196:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e3d350b8/0x2c3a1e2a079d4373 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.32@tcp remote: 0x394e0d883813529f expref: 13 pid: 6669 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784503.813237:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 84 00000100:00100000:1.0:1790784503.813247:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+13:2352:x1877773344929664:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790784503.813264:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784503.813270:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e3d350b8/0x2c3a1e2a079d4373 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.32@tcp remote: 0x394e0d883813529f expref: 13 pid: 6669 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784503.813284:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e3d350b8/0x2c3a1e2a079d4373 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.32@tcp remote: 0x394e0d883813529f expref: 13 pid: 6669 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784503.813313:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790784503.813318:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790784503.813325:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d45b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784503.813336:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d45b8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784503.813358:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790784503.813418:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+13:2352:x1877773344929664:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 172us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784503.813436:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 84 00010000:00010000:3.0:1790784503.816731:0:8181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3d350b8/0x2c3a1e2a079d4373 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.32@tcp remote: 0x394e0d883813529f expref: 12 pid: 6669 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784503.816763:0:8181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8181:1877773359592832:192.168.206.32@tcp:104: 00010000:00010000:3.0:1790784503.816795:0:8181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d45b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784503.816809:0:8181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d45b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784503.816817:0:8181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d45b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784503.816831:0:8181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d45b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784503.816839:0:8181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d45b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784503.816862:0:8181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790784503.817423:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784503.817571:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344929792 00000100:00100000:0.0:1790784503.817582:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344929792 00000100:00100000:0.0:1790784503.817650:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 68 00000100:00100000:0.0:1790784503.817661:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592daa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+12:2349:x1877773344929792:12345-192.168.206.32@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1790784503.820928:0:8181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3280:x1877773359592576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11928us (12922us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1790784503.820945:0:8181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:2.0:1790784503.822615:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790784503.822633:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d45b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.822650:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2f000 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:2.0:1790784503.822656:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d45b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.822669:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d45b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.822696:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d45b8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.822704:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d45b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.822729:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784503.822731:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784503.822743:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1790784503.824963:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94592d9cca80/2, rc 0, transno 4294967322 00000100:00100000:0.0:1790784503.824984:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359592576:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1790784503.867942:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:0.0:1790784503.867968:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:0.0:1790784503.867975:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:0.0:1790784503.867981:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:2.0:1790784503.868157:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592daa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2349:x1877773344929792:12345-192.168.206.32@tcp:16:lhsmtool_posix.0 Request processed in 50489us (50729us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784503.868171:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 68 00000100:00100000:2.0:1790784503.881480:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784503.881718:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344930048 00000100:00100000:0.0:1790784503.881730:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344930048 00000100:00100000:0.0:1790784503.881805:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 227 00000100:00100000:0.0:1790784503.881817:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906a72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+20:11601:x1877773344930048:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790784503.881898:0:9249:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784503.881936:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1c00/0x2c3a1e2a079d459c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135332 expref: 20 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.881983:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff945903a23a00) 00010000:00010000:0.0:1790784503.881989:0:9249:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790784503.882029:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d45bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.882046:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d45bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.882058:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d45bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790784503.882360:0:9249:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e0f2b963 reply state 00000000305327dd transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d45bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784503.882372:0:9249:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790784503.884402:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906a72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+21:11601:x1877773344930048:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 Request processed in 2554us (2903us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1790784503.884415:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 227 00000100:00100000:0.0:1790784503.889062:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784503.889179:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344930176 00000100:00100000:2.0:1790784503.889193:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344930176 00000100:00100000:2.0:1790784503.889272:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 69 00000100:00100000:2.0:1790784503.889284:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2351:x1877773344930176:12345-192.168.206.32@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790784503.891585:0:6668:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1790784503.891607:0:6668:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1790784503 -> 1790784502 00002000:00010000:2.0:1790784503.891610:0:6668:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1790784502 00002000:00010000:2.0:1790784503.891612:0:6668:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1790784503 -> 1790784502 00002000:00010000:2.0:1790784503.891615:0:6668:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1790784503.891921:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:2351:x1877773344930176:12345-192.168.206.32@tcp:2:lhsmtool_posix.0 Request processed in 2633us (3554us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1790784503.891936:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 69 00010000:00010000:1.0:1790784503.892952:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d45bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784503.892971:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d45bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784503.892980:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d45bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784503.892986:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b0600 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784503.892992:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d45bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784503.893000:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d45bf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784503.893022:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff945903a23a00) 00010000:00010000:1.0:1790784503.893025:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784503.893031:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d45bf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784503.893038:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0600/0x2c3a1e2a079d45bf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784503.898233:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784503.898520:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344930432 00000100:00100000:2.0:1790784503.898535:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344930432 00000100:00100000:2.0:1790784503.898670:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 228 00000100:00100000:2.0:1790784503.898683:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+20:11601:x1877773344930432:12345-192.168.206.32@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1790784503.898782:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d45c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.898839:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d4580 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135324 expref: 20 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.898850:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d45c6 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.898915:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d4580 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135324 expref: 20 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.898931:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d4580 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135324 expref: 20 pid: 5820 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784503.898950:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590685d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5819:1877773359592960:192.168.206.32@tcp:104: 00000100:00100000:2.0:1790784503.899076:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593fe4a540 going to sleep for 11 seconds 00000100:00100000:0.0:1790784503.901223:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590685d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5819:1877773359592960:192.168.206.32@tcp:104: 00010000:00010000:0.0:1790784503.901261:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d45c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784503.902976:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784503.903351:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344930560 00000100:00100000:1.0:1790784503.903364:0:5802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344930560 00010000:00010000:1.0:1790784503.903451:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d4580 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135324 expref: 21 pid: 5820 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784503.903509:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 85 00000100:00100000:1.0:1790784503.903520:0:5802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+21:2352:x1877773344930560:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790784503.903550:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784503.903558:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d4580 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135324 expref: 21 pid: 5820 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784503.903573:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d4580 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135324 expref: 21 pid: 5820 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784503.903610:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1000/0x2c3a1e2a079d4580 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135324 expref: 21 pid: 5820 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784503.903641:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff945903a23a00) 00010000:00010000:1.0:1790784503.903647:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d45c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784503.903658:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d45c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784503.903668:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d45c6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784503.903708:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790784503.903788:0:5802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+20:2352:x1877773344930560:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 269us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784503.903796:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 85 00010000:00010000:2.0:1790784503.904315:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d45c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.904326:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d45c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.904364:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d45c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.904371:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d45c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.904419:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d45c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.904440:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74c00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784503.904445:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d45c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.904454:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d45c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.904467:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff945903a23a00) 00010000:00010000:2.0:1790784503.904471:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1790784503.904475:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d45c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.904481:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74c00/0x2c3a1e2a079d45c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784503.904572:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+19:11601:x1877773344930432:12345-192.168.206.32@tcp:55:lhsmtool_posix.0 Request processed in 5889us (6353us total) trans 0 rc -22/-22 00000100:00100000:2.0:1790784503.904581:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 228 00000100:00100000:0.0:1790784503.910740:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784503.911037:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344930688 00000100:00100000:2.0:1790784503.911053:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344930688 00000100:00100000:2.0:1790784503.911122:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 70 00000100:00100000:2.0:1790784503.911132:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945910fc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:2352:x1877773344930688:12345-192.168.206.32@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1790784503.911192:0:6669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006b640d89/0x2c3a1e2a079d45cd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.911221:0:6669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d45aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135340 expref: 8 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.911257:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1790784503.911262:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790784503.911267:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b640d89/0x2c3a1e2a079d45cd lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.911315:0:6669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d45aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135340 expref: 8 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.911332:0:6669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d45aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135340 expref: 8 pid: 6670 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784503.911350:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590685d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6669:1877773359593088:192.168.206.32@tcp:104: 00000100:00100000:2.0:1790784503.912162:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593fe4a840 going to sleep for 11 seconds 00000100:00100000:3.0:1790784503.919102:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784503.919222:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344930816 00000100:00100000:1.0:1790784503.919254:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344930816 00010000:00010000:1.0:1790784503.919307:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d45aa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135340 expref: 9 pid: 6670 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784503.919363:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 86 00000100:00100000:1.0:1790784503.919419:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+9:2352:x1877773344930816:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790784503.919440:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784503.919472:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d45aa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135340 expref: 9 pid: 6670 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784503.919488:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d45aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135340 expref: 9 pid: 6670 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784503.919520:0:5804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790784503.919525:0:5804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790784503.919534:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b640d89/0x2c3a1e2a079d45cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784503.919860:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b640d89/0x2c3a1e2a079d45cd lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784503.919888:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790784503.920055:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+9:2352:x1877773344930816:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 679us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784503.920064:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 86 00010000:00010000:2.0:1790784503.920227:0:6669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008085dae/0x2c3a1e2a079d45aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135340 expref: 8 pid: 6670 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784503.920249:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590685d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6669:1877773359593088:192.168.206.32@tcp:104: 00010000:00010000:2.0:1790784503.920277:0:6669:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006b640d89/0x2c3a1e2a079d45cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.920288:0:6669:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006b640d89/0x2c3a1e2a079d45cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.920295:0:6669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b640d89/0x2c3a1e2a079d45cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.920344:0:6669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006b640d89/0x2c3a1e2a079d45cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.920353:0:6669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b640d89/0x2c3a1e2a079d45cd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.920363:0:6669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b640d89/0x2c3a1e2a079d45cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.920370:0:6669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74e00 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:2.0:1790784503.920423:0:6669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b640d89/0x2c3a1e2a079d45cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.920434:0:6669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b640d89/0x2c3a1e2a079d45cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.920451:0:6669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b640d89/0x2c3a1e2a079d45cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.920459:0:6669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b640d89/0x2c3a1e2a079d45cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784503.920527:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945910fc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2352:x1877773344930688:12345-192.168.206.32@tcp:1:lhsmtool_posix.0 Request processed in 9395us (9803us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784503.920548:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 70 00000100:00100000:0.0:1790784503.925114:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784503.925271:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344931072 00000100:00100000:3.0:1790784503.925303:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344931072 00000100:00100000:3.0:1790784503.925450:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 229 00000100:00100000:3.0:1790784503.925463:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+19:11601:x1877773344931072:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790784503.925575:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d45d4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784503.925605:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d45d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784503.925619:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d45d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784503.926027:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d45db lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784503.926042:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d458e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813532b expref: 20 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784503.926050:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d45db lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784503.926099:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d458e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813532b expref: 20 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784503.926116:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d458e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813532b expref: 20 pid: 5819 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784503.926131:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9ce300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5818:1877773359593216:192.168.206.32@tcp:104: 00000100:00100000:3.0:1790784503.926335:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459050c0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790784503.931414:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784503.931510:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344931200 00000100:00100000:0.0:1790784503.931523:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344931200 00010000:00010000:0.0:1790784503.931599:0:8421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d458e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813532b expref: 21 pid: 5819 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784503.931789:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 87 00000100:00100000:0.0:1790784503.931801:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590685d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+21:2352:x1877773344931200:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790784503.931820:0:8421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784503.931948:0:8421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d458e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813532b expref: 21 pid: 5819 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.931965:0:8421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d458e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813532b expref: 21 pid: 5819 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.931992:0:8421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff945903a23a00) 00010000:00010000:0.0:1790784503.931999:0:8421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d45db lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.932011:0:8421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d45db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.932021:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d45db lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.932046:0:8421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790784503.932128:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590685d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+21:2352:x1877773344931200:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 329us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784503.932136:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 87 00010000:00010000:3.0:1790784503.933900:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0c00/0x2c3a1e2a079d458e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813532b expref: 20 pid: 5819 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784503.933952:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9ce300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5818:1877773359593216:192.168.206.32@tcp:104: 00010000:00010000:3.0:1790784503.933985:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d45db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.934091:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d45db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.934099:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d45db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790784503.934756:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1790784503.935018:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1790784503.935069:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1790784503.935334:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590685d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5818:1877773359593344:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790784503.935740:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784503.935860:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593fe4a780 going to sleep for 11 seconds 00000100:00100000:1.0:1790784503.935967:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359593344 00000100:00100000:1.0:1790784503.935977:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359593344 00000100:00100000:1.0:1790784503.936110:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790784503.936122:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590685ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5818:x1877773359593344:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790784503.936419:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590685ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5818:x1877773359593344:12345-0@lo:1000:mdt00_000.0 Request processed in 298us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784503.936429:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790784503.936706:0:5818:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:2.0:1790784503.936713:0:5818:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:2.0:1790784503.936737:0:5818:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94592d9cf800, transno 4294967321 00000100:00100000:2.0:1790784503.936791:0:5818:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94592d9cca80 x1877773359592576/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790784519 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790784503.936806:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590685d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5818:1877773359593344:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1790784503.938484:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1790784503.938718:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590685d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5818:1877773359593472:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790784503.938801:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784503.938947:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593fe4a840 going to sleep for 11 seconds 00000100:00100000:0.0:1790784503.941011:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359593472 00000100:00100000:0.0:1790784503.941031:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359593472 00000100:00100000:0.0:1790784503.941122:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790784503.941135:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590685e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5818:x1877773359593472:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790784503.941571:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590685e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5818:x1877773359593472:12345-0@lo:1000:mdt00_000.0 Request processed in 437us (2768us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1790784503.941580:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790784503.941940:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590685d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5818:1877773359593472:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1790784503.941994:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d45db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.942007:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d45db lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.942029:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d45db lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.942035:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2e800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784503.942040:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d45db lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.942049:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d45db lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.942068:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff945903a23a00) 00010000:00010000:2.0:1790784503.942071:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790784503.942077:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d45db lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.942084:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e800/0x2c3a1e2a079d45db lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.942121:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d451e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.942128:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d451e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.942134:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d451e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.942139:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b1600 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784503.942142:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d451e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.942159:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d451e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.942178:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94590345d700) 00010000:00010000:2.0:1790784503.942181:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790784503.942190:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d4525 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813530f expref: 23 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.942203:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d4525 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813530f expref: 23 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.942214:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d4525 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813530f expref: 23 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.942257:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d4525 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813530f expref: 23 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784503.942272:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590685f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5818:1877773359593600:192.168.206.32@tcp:105: 00000100:00100000:2.0:1790784503.942358:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593fe4a840 going to sleep for 11 seconds 00000100:00100000:0.0:1790784503.948458:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784503.948864:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344931328 00000100:00100000:3.0:1790784503.948877:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344931328 00000100:00100000:3.0:1790784503.948957:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 61 00000100:00100000:3.0:1790784503.948970:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+24:11600:x1877773344931328:12345-192.168.206.32@tcp:49:lfs.0 00000100:00100000:3.0:1790784503.949149:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+24:11600:x1877773344931328:12345-192.168.206.32@tcp:49:lfs.0 Request processed in 181us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784503.949158:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 61 00000100:00100000:2.0:1790784503.952016:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590685f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5818:1877773359593600:192.168.206.32@tcp:105: 00010000:00010000:2.0:1790784503.952062:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d451e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.952076:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1600/0x2c3a1e2a079d451e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.952127:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d45e2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.952174:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d45e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.952192:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d45e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.952208:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d45e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.952215:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d45e2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.952223:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d45e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.952230:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74e00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784503.952235:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d45e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.952244:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d45e2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.952256:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94590345d700) 00010000:00010000:2.0:1790784503.952260:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784503.952264:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d45e2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.952271:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d45e2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.952283:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d45d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.952296:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d45d4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.952303:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d45d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.952308:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2f400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784503.952312:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d45d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.952319:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d45d4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.952327:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94590345d700) 00010000:00010000:2.0:1790784503.952330:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790784503.952333:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d45d4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.952339:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d45d4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784503.952672:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+23:11601:x1877773344931072:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 Request processed in 27208us (27568us total) trans 4294967513 rc 0/0 00000100:00100000:2.0:1790784503.952685:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 229 00000020:00080000:2.0:1790784503.952694:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1790784503.953749:0:11656:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790784503.953758:0:11656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790784503.954423:0:11656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1790784503.954437:0:11656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790784503.954911:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784503.957784:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344931584 00000100:00100000:2.0:1790784503.957803:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344931584 00000100:00100000:2.0:1790784503.957904:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 230 00000100:00100000:2.0:1790784503.957917:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+23:11600:x1877773344931584:12345-192.168.206.32@tcp:58:lfs.0 00000040:00080000:2.0:1790784503.958682:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1790784503.958811:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+23:11600:x1877773344931584:12345-192.168.206.32@tcp:58:lfs.0 Request processed in 894us (3903us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784503.965025:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784503.965125:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344931840 00000100:00100000:0.0:1790784503.965138:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344931840 00000100:00100000:0.0:1790784503.965214:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 62 00000100:00100000:0.0:1790784503.965225:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc14c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+24:11601:x1877773344931840:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1790784503.966077:0:5822:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1790784503.966190:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:0.0:1790784503.966244:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d45e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.966265:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d45e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.966279:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d45e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.966290:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d45e9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.966297:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d45e9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.966303:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d45e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784503.966338:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790784503.966489:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc14c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+26:11601:x1877773344931840:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 Request processed in 1262us (1474us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1790784503.966500:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 62 00000020:00080000:0.0:1790784503.966507:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1790784503.966828:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 230 00010000:00010000:1.0:1790784503.968539:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790784503.968561:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d45e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784503.968576:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b0800 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:1.0:1790784503.968583:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d45e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784503.968609:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d45e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784503.968645:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff945903a23800) 00010000:00010000:1.0:1790784503.968649:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790784503.968656:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d45e9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784503.968664:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0800/0x2c3a1e2a079d45e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784503.968699:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784503.968701:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784503.968703:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784503.996576:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784503.996742:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344931968 00000100:00100000:2.0:1790784503.996757:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344931968 00000100:00100000:2.0:1790784503.996846:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 231 00000100:00100000:2.0:1790784503.996859:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+25:11603:x1877773344931968:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:2.0:1790784503.996894:0:9249:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784503.996921:0:9249:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d45f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135347 expref: -99 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.997003:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d45f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.997022:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d45f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.997036:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d45f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.997051:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d45fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.997057:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d45fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.997064:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d45fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.997561:0:9249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d4605 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.997577:0:9249:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4510 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135308 expref: 26 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.997603:0:9249:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d4605 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.997769:0:9249:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4510 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135308 expref: 26 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784503.997787:0:9249:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4510 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135308 expref: 26 pid: 9249 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784503.997805:0:9249:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590685f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9249:1877773359593728:192.168.206.32@tcp:104: 00000100:00100000:2.0:1790784503.998280:0:9249:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593fe4a540 going to sleep for 11 seconds 00000100:00100000:0.0:1790784504.001939:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784504.002121:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344932224 00000100:00100000:1.0:1790784504.002133:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344932224 00000100:00100000:1.0:1790784504.002207:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 63 00000100:00100000:1.0:1790784504.002219:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+27:5590:x1877773344932224:12345-192.168.206.32@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790784504.002575:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+28:5590:x1877773344932224:12345-192.168.206.32@tcp:35:ldlm_bl.0 Request processed in 356us (646us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1790784504.002585:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 63 00000100:00100000:2.0:1790784504.003444:0:9249:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590685f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9249:1877773359593728:192.168.206.32@tcp:104: 00010000:00010000:2.0:1790784504.003481:0:9249:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d4605 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784504.005585:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784504.005957:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344932352 00000100:00100000:0.0:1790784504.005970:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344932352 00010000:00010000:0.0:1790784504.006022:0:8480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4510 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135308 expref: 28 pid: 9249 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784504.006078:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 88 00000100:00100000:0.0:1790784504.006090:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905104050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b0f9e8c2-ddb0-4027-babe-0b166585860c+28:2352:x1877773344932352:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790784504.006111:0:8480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784504.006119:0:8480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4510 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135308 expref: 28 pid: 9249 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784504.006134:0:8480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4510 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135308 expref: 28 pid: 9249 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784504.006163:0:8480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4510 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135308 expref: 28 pid: 9249 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784504.006198:0:8480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94590345d700) 00010000:00010000:0.0:1790784504.006204:0:8480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d4605 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784504.006231:0:8480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d4605 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784504.006240:0:8480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d4605 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784504.006279:0:8480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790784504.006354:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905104050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b0f9e8c2-ddb0-4027-babe-0b166585860c+27:2352:x1877773344932352:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 266us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784504.006362:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 88 00010000:00010000:2.0:1790784504.006528:0:9249:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d4605 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784504.006538:0:9249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d4605 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784504.006604:0:9249:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1790784504.006618:0:9249:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790784504.006655:0:9249:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d4605 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784504.006670:0:9249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d4605 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784504.006682:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d45f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784504.006689:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d45f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784504.006696:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d45f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784504.006702:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784504.006707:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d45f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784504.006716:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d45f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784504.006727:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94590345dc00) 00010000:00010000:2.0:1790784504.006730:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784504.006734:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d45f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784504.006741:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d45f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784504.006754:0:9249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d45fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784504.006770:0:9249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d45fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784504.006777:0:9249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d45fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784504.006782:0:9249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784504.006785:0:9249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d45fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784504.006791:0:9249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d45fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784504.006800:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff945903af2a00) 00010000:00010000:2.0:1790784504.006803:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784504.006806:0:9249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d45fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784504.006812:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d45fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9249 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784504.006868:0:9249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d45f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135347 expref: 27 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784504.006883:0:9249:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d4605 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135347 expref: 26 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784504.006891:0:9249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94590345d700) 00010000:00010000:2.0:1790784504.006894:0:9249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790784504.006903:0:9249:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe75200, rc 0) 00000100:00100000:2.0:1790784504.006941:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+26:11603:x1877773344931968:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 10086us (10379us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784504.006950:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 231 00010000:00010000:3.0:1790784504.318507:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790784504.955825:0:11656:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790784504.955839:0:11656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790784504.955879:0:11656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1790784504.955885:0:11656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790784504.956041:0:11656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c3100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11656:1877773359593856:192.168.206.32@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790784504.956547:0:11656:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593f57f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790784504.974370:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784504.974465:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344932480 00000100:00100000:0.0:1790784504.974478:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344932480 00000100:00100000:0.0:1790784504.974554:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 232 00000100:00100000:0.0:1790784504.974577:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+27:11614:x1877773344932480:12345-192.168.206.32@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790784504.974642:0:5819:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790784504.974793:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+27:11614:x1877773344932480:12345-192.168.206.32@tcp:53:lhsmtool_posix.0 Request processed in 229us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784504.974802:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 232 00000100:00100000:1.0:1790784504.977466:0:11656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c3100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11656:1877773359593856:192.168.206.32@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790784504.991248:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784504.991559:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344932736 00000100:00100000:2.0:1790784504.991591:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344932736 00000100:00100000:2.0:1790784504.991674:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 233 00000100:00100000:2.0:1790784504.991686:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592daa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+26:11614:x1877773344932736:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790784504.991714:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784504.991741:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d460c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813534e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784504.991882:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4613 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784504.991901:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784504.991919:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784504.991935:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1790784504.992127:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d460c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813534e expref: 29 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784504.992157:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4613 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813534e expref: 28 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784504.992167:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94590345d700) 00010000:00010000:2.0:1790784504.992186:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790784504.992192:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74400, rc 0) 00000100:00100000:2.0:1790784504.992273:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592daa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+28:11614:x1877773344932736:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 590us (1041us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1790784504.992281:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 233 00000100:00100000:3.0:1790784505.006465:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784505.006512:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784505.006548:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344933120 00000100:00100000:3.0:1790784505.006560:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344933120 00000100:00100000:3.0:1790784505.006676:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 16 00000100:00100000:3.0:1790784505.006688:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+28:2351:x1877773344933120:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790784505.006720:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784505.006754:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4613 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813534e expref: 28 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784505.006803:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94590345d700) 00010000:00010000:3.0:1790784505.006810:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790784505.006874:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+27:2351:x1877773344933120:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 189us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784505.006882:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 16 00000100:00080000:3.0:1790784505.006906:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790784505.007113:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344932992 00000100:00100000:1.0:1790784505.007118:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344932992 00000100:00100000:1.0:1790784505.007155:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 234 00000100:00100000:1.0:1790784505.007163:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+27:11614:x1877773344932992:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790784505.007248:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4621 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784505.007265:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4621 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784505.007277:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4621 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784505.007537:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4621 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784505.007546:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4621 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784505.007553:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4621 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784505.007559:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030e00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784505.007564:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4621 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784505.007593:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4621 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784505.007605:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94590345d700) 00010000:00010000:1.0:1790784505.007608:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790784505.007613:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4621 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784505.007620:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4621 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784505.007764:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+28:11614:x1877773344932992:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 Request processed in 600us (1316us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1790784505.007773:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 234 00000040:00080000:1.0:1790784505.007904:0:11656:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790784505.007909:0:11656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790784505.009602:0:11656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1790784505.009637:0:11656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790784505.021442:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784505.021616:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344933376 00000100:00100000:1.0:1790784505.021639:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344933376 00000100:00100000:1.0:1790784505.021724:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 64 00000100:00100000:1.0:1790784505.021737:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+28:11614:x1877773344933376:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790784505.022095:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+29:11614:x1877773344933376:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 Request processed in 359us (721us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1790784505.022104:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 64 00000040:00080000:1.0:1790784505.070936:0:12532:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790784505.070951:0:12532:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790784505.071588:0:12532:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1790784505.071596:0:12532:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1790784505.344631:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790784505.415209:0:6693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1790784505.415227:0:6693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1790784505.415233:0:6693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:3.0:1790784505.445270:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784505.445436:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344933632 00000100:00100000:2.0:1790784505.445451:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344933632 00000100:00100000:2.0:1790784505.445515:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 235 00000100:00100000:2.0:1790784505.445525:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+29:11627:x1877773344933632:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:2.0:1790784505.445557:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784505.445596:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4628 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135355 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784505.445739:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d462f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784505.445757:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d462f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784505.445770:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d462f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784505.445783:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1790784505.445962:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4628 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135355 expref: 32 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784505.445984:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d462f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135355 expref: 31 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784505.446015:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94590345d700) 00010000:00010000:2.0:1790784505.446019:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790784505.446023:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74400, rc 0) 00000100:00100000:2.0:1790784505.446102:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+31:11627:x1877773344933632:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 578us (847us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1790784505.446110:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 235 00000100:00100000:3.0:1790784505.451213:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784505.451319:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344933760 00000100:00100000:1.0:1790784505.451332:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344933760 00000100:00100000:1.0:1790784505.451464:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 236 00000100:00100000:1.0:1790784505.451477:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+31:11627:x1877773344933760:12345-192.168.206.32@tcp:54:lfs.0 00010000:00010000:1.0:1790784505.451567:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d463d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784505.451598:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d463d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784505.451622:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d463d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784505.451657:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d463d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784505.451665:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d463d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784505.451673:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d463d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784505.451679:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900031800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784505.451684:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d463d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784505.451692:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d463d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784505.451720:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94590345d700) 00010000:00010000:1.0:1790784505.451724:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790784505.451732:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d463d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784505.451739:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d463d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784505.451846:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+31:11627:x1877773344933760:12345-192.168.206.32@tcp:54:lfs.0 Request processed in 372us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784505.451855:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 236 00000100:00100000:3.0:1790784505.562073:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784505.562292:0:8181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344933888 00000100:00100000:1.0:1790784505.562308:0:8181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344933888 00000100:00100000:1.0:1790784505.562445:0:8181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 71 00000100:00100000:1.0:1790784505.562459:0:8181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2352:x1877773344933888:12345-192.168.206.32@tcp:101:cat.0 00010000:00010000:1.0:1790784505.562482:0:8181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784505.562505:0:8181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d4644 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813535c expref: -99 pid: 8181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790784505.562539:0:8181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6abd33f6, atime: 0x6abd33f6, ctime: 0x6abd33f6, blocks: 0xb 00010000:00010000:1.0:1790784505.562565:0:8181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=339s v=(0 0) 00010000:00010000:1.0:1790784505.562571:0:8181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784505.562594:0:8181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d4644 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813535c expref: 8 pid: 8181 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784505.562793:0:8181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d4644 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813535c expref: 8 pid: 8181 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784505.562847:0:8181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945900031800, rc 0) 00000100:00080000:3.0:1790784505.563024:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790784505.563479:0:8181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:2352:x1877773344933888:12345-192.168.206.32@tcp:101:cat.0 Request processed in 1018us (1416us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784505.563488:0:8181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 71 00000100:00100000:2.0:1790784505.567248:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784505.567323:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344934016 00000100:00100000:3.0:1790784505.567337:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344934016 00002000:00100000:3.0:1790784505.567427:0:6674:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff94590685f800 x1877773344934016/t0(0) o3->b0f9e8c2-ddb0-4027-babe-0b166585860c@192.168.206.32@tcp:16/0 lens 488/0 e 0 to 0 dl 1790784516 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790784505.567440:0:6674:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94590685f800 with x1877773344934016 ext(0->4095) 00002000:00010000:3.0:1790784505.567446:0:6674:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94590685f800 00000100:00100000:3.0:1790784505.567482:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 7 00000100:00100000:3.0:1790784505.567492:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590685f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:2351:x1877773344934016:12345-192.168.206.32@tcp:3:cat.0 00000100:00100000:3.0:1790784505.568157:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590685f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+8:2351:x1877773344934016:12345-192.168.206.32@tcp:3:cat.0 Request processed in 663us (918us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1790784505.568179:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 7 00002000:00100000:3.0:1790784505.568187:0:6674:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff94590685f800 x1877773344934016/t0(0) o3->b0f9e8c2-ddb0-4027-babe-0b166585860c@192.168.206.32@tcp:16/0 lens 488/4536 e 0 to 0 dl 1790784516 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790784505.568219:0:6674:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94590685f800 with x1877773344934016 ext(0->4095) 00002000:00010000:3.0:1790784505.568224:0:6674:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94590685f800 00000100:00100000:2.0:1790784506.283171:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784506.283307:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784506.283346:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784506.283436:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344934144 00000100:00100000:3.0:1790784506.283449:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344934144 00000100:00100000:3.0:1790784506.283517:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 298 00000100:00100000:3.0:1790784506.283527:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2350:x1877773344934144:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1790784506.283611:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2350:x1877773344934144:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 85us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784506.283629:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 298 00000100:00100000:1.0:1790784506.289151:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344934400 00000100:00100000:1.0:1790784506.289175:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344934400 00000100:00100000:1.0:1790784506.289317:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 160 00000100:00100000:1.0:1790784506.289330:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590685e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2350:x1877773344934400:12345-192.168.206.32@tcp:400:kworker.0 00000100:00080000:3.0:1790784506.289414:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790784506.289486:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590685e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2350:x1877773344934400:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 159us (6139us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784506.289495:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 160 00000100:00100000:0.0:1790784506.293047:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344934272 00000100:00100000:0.0:1790784506.293068:0:6670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344934272 00000100:00100000:0.0:1790784506.293201:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 79 00000100:00100000:0.0:1790784506.293213:0:6670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590685ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2350:x1877773344934272:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:0.0:1790784506.293340:0:6670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590685ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2350:x1877773344934272:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 130us (10187us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784506.293348:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 79 00000100:00080000:3.0:1790784506.295602:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790784506.365632:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790784507.073830:0:11656:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790784507.073839:0:11656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790784507.073873:0:11656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1790784507.073879:0:11656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1790784507.386704:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784508.347143:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359593984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790784508.347210:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784508.347689:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1877773359594240:0@lo:400:kworker.0 00000100:00100000:1.0:1790784508.347725:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784508.347746:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790784508.347752:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359594368:0@lo:400:kworker.0 00000100:00100000:1.0:1790784508.347772:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784508.347803:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359594240 00000100:00100000:1.0:1790784508.347809:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359594240 00000100:00100000:1.0:1790784508.347849:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359594368 00000100:00100000:1.0:1790784508.347852:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359594368 00000100:00100000:1.0:1790784508.347895:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1790784508.347903:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592daa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1877773359594240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784508.347949:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592daa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1877773359594240:12345-0@lo:400:kworker.0 Request processed in 47us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784508.347956:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1790784508.347970:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1790784508.347977:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592daa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359594368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784508.348019:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592daa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359594368:12345-0@lo:400:kworker.0 Request processed in 43us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784508.348025:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:1.0:1790784508.348045:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790784508.348073:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359594368:0@lo:400:kworker.0 00000100:00100000:1.0:1790784508.348084:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1877773359594240:0@lo:400:kworker.0 00000100:00100000:2.0:1790784508.348239:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1877773359594496:0@lo:400:kworker.0 00000100:00100000:2.0:1790784508.348267:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784508.348295:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790784508.348301:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359594112:0@lo:400:kworker.0 00000100:00100000:2.0:1790784508.348328:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784508.348351:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359594624:0@lo:400:kworker.0 00000100:00100000:2.0:1790784508.348395:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784508.348421:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359594496 00000100:00100000:2.0:1790784508.348431:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359594496 00000100:00100000:2.0:1790784508.348646:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790784508.348653:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590685ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1877773359594496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784508.348690:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590685ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1877773359594496:12345-0@lo:400:kworker.0 Request processed in 37us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784508.348696:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790784508.348717:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359594112 00000100:00100000:2.0:1790784508.348721:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359594112 00000100:00100000:2.0:1790784508.348747:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1790784508.348753:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3281:x1877773359594112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784508.348781:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3281:x1877773359594112:12345-0@lo:400:kworker.0 Request processed in 29us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784508.348787:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1790784508.348811:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359594624 00000100:00100000:2.0:1790784508.348814:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359594624 00000100:00100000:2.0:1790784508.348838:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790784508.348844:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590685ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3281:x1877773359594624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784508.350901:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359593984 00000100:00100000:0.0:1790784508.350910:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359593984 00000100:00100000:0.0:1790784508.350947:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790784508.350954:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590685f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359593984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790784508.350985:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1790784508.351165:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790784508.351169:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790784508.351173:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790784508.351240:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590685ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3281:x1877773359594624:12345-0@lo:400:kworker.0 Request processed in 2394us (2863us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784508.351250:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790784508.351260:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590685f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359593984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 305us (4048us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784508.351268:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790784508.361991:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359594112:0@lo:400:kworker.0 00000100:00100000:2.0:1790784508.362154:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359594624:0@lo:400:kworker.0 00000100:00100000:2.0:1790784508.362167:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1877773359594496:0@lo:400:kworker.0 00000100:00100000:2.0:1790784508.362178:0:3281:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1790784508.362183:0:3281:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1790784508.362206:0:3281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9459102e8700, transno 4294967310 00000100:00100000:2.0:1790784508.362239:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359593984:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790784508.410651:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790784508.859061:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359594752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790784508.859128:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784508.859253:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359594752 00000100:00100000:3.0:1790784508.859261:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359594752 00000100:00100000:3.0:1790784508.859312:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790784508.859321:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592daa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1877773359594752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790784508.859351:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790784508.859418:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592daa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1877773359594752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784508.859440:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790784508.859478:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359594752:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1790784508.930038:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1790784508.930129:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:2.0:1790784508.936766:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967515 is committed 00000020:00080000:2.0:1790784508.936782:0:5841:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:2.0:1790784508.936800:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000001:00080000:2.0:1790784508.936813:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1790784508.936824:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:2.0:1790784508.936828:0:5841:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94593fe4a780 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1790784508.936832:0:5841:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94592a99f400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94593fe4aa80 00000020:00080000:2.0:1790784508.936835:0:5841:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94592a99f700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945907ef8c00 00000020:00080000:0.0:1790784508.936838:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1790784508.937011:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1790784509.435132:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784510.458569:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790784511.420819:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784511.420857:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784511.420887:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784511.420905:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784511.420932:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784511.420985:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344934528 00000100:00100000:1.0:1790784511.420998:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344934528 00000100:00100000:1.0:1790784511.421062:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 300 00000100:00100000:1.0:1790784511.421073:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2352:x1877773344934528:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784511.421157:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2352:x1877773344934528:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 86us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784511.421166:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 300 00000100:00100000:1.0:1790784511.421199:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344935040 00000100:00100000:1.0:1790784511.421202:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344935040 00000100:00100000:1.0:1790784511.421234:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344934656 00000100:00100000:1.0:1790784511.421244:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344934656 00000100:00100000:1.0:1790784511.421265:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 164 00000100:00100000:1.0:1790784511.421271:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592daa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2352:x1877773344935040:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784511.421300:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592daa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:2352:x1877773344935040:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 30us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784511.421307:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 164 00000100:00100000:1.0:1790784511.421318:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 165 00000100:00100000:1.0:1790784511.421323:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592daa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+18:2352:x1877773344934656:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784511.421344:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592daa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+18:2352:x1877773344934656:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 21us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784511.421350:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 165 00000100:00100000:1.0:1790784511.421367:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344934784 00000100:00100000:1.0:1790784511.421370:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344934784 00000100:00100000:1.0:1790784511.421415:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344934912 00000100:00100000:1.0:1790784511.421418:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344934912 00000100:00100000:1.0:1790784511.421434:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 81 00000100:00100000:1.0:1790784511.421440:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592daa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2352:x1877773344934784:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784511.421461:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592daa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2352:x1877773344934784:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 21us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784511.421467:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 81 00000100:00100000:1.0:1790784511.421476:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 82 00000100:00100000:1.0:1790784511.421481:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592daa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2352:x1877773344934912:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784511.421499:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592daa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2352:x1877773344934912:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 18us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784511.421505:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 82 00000100:00080000:1.0:1790784511.422690:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790784511.422700:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790784511.422703:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790784511.484171:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784511.592899:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784511.592988:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344935168 00000100:00100000:1.0:1790784511.593001:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344935168 00000100:00100000:1.0:1790784511.593079:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 237 00000100:00100000:1.0:1790784511.593093:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+18:11280:x1877773344935168:12345-192.168.206.32@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1790784511.593242:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b0f9e8c2-ddb0-4027-babe-0b166585860c+18:11280:x1877773344935168:12345-192.168.206.32@tcp:60:lhsmtool_posix.0 Request processed in 153us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784511.593251:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 237 00000100:00100000:1.0:1790784511.604078:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784511.604158:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344935424 00000100:00100000:3.0:1790784511.604171:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344935424 00000100:00100000:3.0:1790784511.604246:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 65 00000100:00100000:3.0:1790784511.604258:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592daa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+18:11280:x1877773344935424:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790784511.604736:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592daa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+19:11280:x1877773344935424:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 Request processed in 477us (671us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1790784511.604745:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 65 00010000:00010000:3.0:1790784512.509148:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784513.468523:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359595264:0@lo:400:kworker.0 00000100:00100000:3.0:1790784513.468626:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784513.468711:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790784513.468718:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359594880:0@lo:400:kworker.0 00000100:00100000:3.0:1790784513.468753:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784513.468917:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1877773359595392:0@lo:400:kworker.0 00000100:00100000:3.0:1790784513.468953:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784513.468988:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3282:1877773359595136:0@lo:400:kworker.0 00000100:00100000:3.0:1790784513.469014:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784513.469032:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1790784513.469038:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1877773359595008:0@lo:400:kworker.0 00000100:00100000:3.0:1790784513.469063:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784513.469082:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359595520:0@lo:400:kworker.0 00000100:00100000:3.0:1790784513.469116:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784513.469152:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359595264 00000100:00100000:3.0:1790784513.469162:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359595264 00000100:00100000:3.0:1790784513.469242:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359595520 00000100:00100000:3.0:1790784513.469245:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359595520 00000100:00100000:3.0:1790784513.469270:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790784513.469281:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d345500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359595264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784513.469351:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d345500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359595264:12345-0@lo:400:kworker.0 Request processed in 71us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784513.469358:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790784513.469410:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790784513.469418:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d347800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359595520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784513.469452:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d347800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359595520:12345-0@lo:400:kworker.0 Request processed in 36us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784513.469458:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790784513.469479:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359594880 00000100:00100000:3.0:1790784513.469483:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359594880 00000100:00100000:3.0:1790784513.469511:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1790784513.469518:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3279:x1877773359594880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784513.469562:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3279:x1877773359594880:12345-0@lo:400:kworker.0 Request processed in 45us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784513.469569:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1790784513.469597:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359595392 00000100:00100000:3.0:1790784513.469601:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359595392 00000100:00100000:3.0:1790784513.469625:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359595136 00000100:00100000:3.0:1790784513.469629:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359595136 00000100:00100000:3.0:1790784513.469640:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359595008 00000100:00100000:3.0:1790784513.469643:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359595008 00000100:00100000:3.0:1790784513.469668:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1790784513.469675:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1877773359595392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784513.469708:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1877773359595392:12345-0@lo:400:kworker.0 Request processed in 35us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784513.469715:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1790784513.469727:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1790784513.469733:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1877773359595136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784513.469765:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1877773359595136:12345-0@lo:400:kworker.0 Request processed in 33us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784513.470356:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1790784513.470368:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1877773359595008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784513.470446:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1877773359595008:12345-0@lo:400:kworker.0 Request processed in 81us (1381us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784513.470453:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:2.0:1790784513.470517:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790784513.470523:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790784513.470526:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790784513.470580:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359594880:0@lo:400:kworker.0 00000100:00100000:2.0:1790784513.470599:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1877773359595392:0@lo:400:kworker.0 00000100:00100000:2.0:1790784513.470613:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359595264:0@lo:400:kworker.0 00000100:00100000:2.0:1790784513.470685:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1877773359595008:0@lo:400:kworker.0 00000100:00100000:2.0:1790784513.470697:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1790784513.470703:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94592d9cca80, transno 4294967322 00000004:00080000:2.0:1790784513.470721:0:3282:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1790784513.470751:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359595520:0@lo:400:kworker.0 00000100:00100000:2.0:1790784513.470765:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3282:1877773359595136:0@lo:400:kworker.0 00000100:00100000:1.0:1790784513.474811:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790784513.474841:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359595648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790784513.474932:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784513.474993:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359595648 00000100:00100000:1.0:1790784513.475003:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359595648 00000100:00100000:1.0:1790784513.475061:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790784513.475071:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592daa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359595648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790784513.475111:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790784513.475162:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592daa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359595648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784513.475170:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790784513.475233:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359595648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790784513.475652:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00010000:00010000:2.0:1790784513.542417:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784513.989397:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790784513.989434:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359595776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790784513.989526:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784513.989618:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359595776 00000100:00100000:2.0:1790784513.989628:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359595776 00000100:00100000:2.0:1790784513.989683:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790784513.989692:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590685d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359595776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790784513.989736:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790784513.989789:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590685d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359595776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784513.989797:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790784513.989851:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359595776:0@lo:13:osp-pre-1-0.0 00000020:00080000:2.0:1790784514.120611:0:5841:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:2.0:1790784514.120649:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:1.0:1790784514.120744:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1790784514.120759:0:5852:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:02000400:1.0:1790784514.264037:0:12736:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 12:08:32 (1790784512) 00010000:00010000:2.0:1790784514.555651:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784515.578601:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784516.523713:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784516.523815:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344935552 00000100:00100000:1.0:1790784516.523825:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344935552 00000100:00100000:1.0:1790784516.523879:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 302 00000100:00100000:1.0:1790784516.523888:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2351:x1877773344935552:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784516.523960:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2351:x1877773344935552:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 74us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784516.523967:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 302 00000100:00100000:0.0:1790784516.524461:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784516.524533:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344935808 00000100:00100000:3.0:1790784516.524538:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344935808 00000100:00100000:3.0:1790784516.524598:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 85 00000100:00100000:3.0:1790784516.524606:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2351:x1877773344935808:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1790784516.524650:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2351:x1877773344935808:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 46us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784516.524658:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 85 00000100:00080000:2.0:1790784516.524710:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790784516.529725:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784516.529759:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784516.529876:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784516.534049:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784516.534081:0:8181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344935936 00000100:00100000:2.0:1790784516.534089:0:8181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344935936 00000100:00100000:2.0:1790784516.534140:0:8181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 86 00000100:00100000:2.0:1790784516.534160:0:8181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590685df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2351:x1877773344935936:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1790784516.534224:0:8181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590685df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2351:x1877773344935936:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 65us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784516.534231:0:8181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 86 00000100:00080000:2.0:1790784516.534254:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790784516.534694:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344936064 00000100:00100000:3.0:1790784516.534700:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344936064 00000100:00100000:3.0:1790784516.534734:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344936192 00000100:00100000:3.0:1790784516.534737:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344936192 00000100:00100000:3.0:1790784516.534749:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344935680 00000100:00100000:3.0:1790784516.534752:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344935680 00000100:00100000:3.0:1790784516.534766:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 169 00000100:00100000:3.0:1790784516.534772:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590685c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+6:2351:x1877773344936064:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1790784516.534806:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590685c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+6:2351:x1877773344936064:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 34us (5089us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784516.534820:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 169 00000100:00100000:3.0:1790784516.534834:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 170 00000100:00100000:3.0:1790784516.534841:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590685c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+18:2351:x1877773344935680:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1790784516.534871:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590685c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+18:2351:x1877773344935680:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 30us (4995us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784516.534877:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 170 00000100:00100000:3.0:1790784516.534891:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 238 00000100:00100000:3.0:1790784516.534898:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590685fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+5:12293:x1877773344936192:12345-192.168.206.32@tcp:101:lsof.0 00010000:00010000:3.0:1790784516.534907:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784516.534925:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2fa00/0x2c3a1e2a079d464b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135363 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784516.534984:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4652 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784516.534997:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4652 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784516.535010:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4652 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790784516.535043:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790784516.535047:0:5819:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790784516.535083:0:5819:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4652 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784516.535108:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2fa00/0x2c3a1e2a079d464b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135363 expref: 7 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784516.535132:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4652 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135363 expref: 6 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784516.535140:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2b00) 00010000:00010000:3.0:1790784516.535143:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790784516.535146:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945802d2e600, rc 0) 00000100:00100000:3.0:1790784516.535168:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590685fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+6:12293:x1877773344936192:12345-192.168.206.32@tcp:101:lsof.0 Request processed in 271us (5409us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784516.535174:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 238 00000100:00080000:2.0:1790784516.535246:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790784516.602562:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790784517.307491:0:11656:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790784517.307500:0:11656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790784517.307973:0:11656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1790784517.307980:0:11656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1790784517.626682:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790784517.934404:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784517.934474:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344936448 00000100:00100000:3.0:1790784517.934482:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344936448 00000100:00100000:3.0:1790784517.934551:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 66 00000100:00100000:3.0:1790784517.934562:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592daa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+18:12294:x1877773344936448:12345-192.168.206.32@tcp:35:umount.0 00000100:00100000:3.0:1790784517.934885:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592daa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+19:12294:x1877773344936448:12345-192.168.206.32@tcp:35:umount.0 Request processed in 323us (514us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1790784517.934892:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 66 00000100:00100000:1.0:1790784517.939504:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784517.939798:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344936704 00000100:00100000:2.0:1790784517.939811:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344936704 00000100:00100000:2.0:1790784517.939887:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 67 00000100:00100000:2.0:1790784517.939899:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592daa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+19:12294:x1877773344936704:12345-192.168.206.32@tcp:35:umount.0 00000100:00100000:2.0:1790784517.940525:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592daa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+20:12294:x1877773344936704:12345-192.168.206.32@tcp:35:umount.0 Request processed in 617us (1023us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1790784517.940535:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 67 00000100:00100000:2.0:1790784517.944242:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784517.945007:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344936960 00000100:00100000:1.0:1790784517.945022:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344936960 00000100:00100000:1.0:1790784517.945144:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 68 00000100:00100000:1.0:1790784517.945157:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc17850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+20:12294:x1877773344936960:12345-192.168.206.32@tcp:35:umount.0 00000100:00100000:1.0:1790784517.945763:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc17850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+21:12294:x1877773344936960:12345-192.168.206.32@tcp:35:umount.0 Request processed in 605us (1531us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1790784517.945773:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 68 00000100:00100000:1.0:1790784517.949876:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784517.950026:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344937216 00000100:00100000:3.0:1790784517.950039:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344937216 00000100:00100000:3.0:1790784517.950112:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 69 00000100:00100000:3.0:1790784517.950124:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592daa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+21:12294:x1877773344937216:12345-192.168.206.32@tcp:35:umount.0 00000100:00100000:3.0:1790784517.951111:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592daa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b0f9e8c2-ddb0-4027-babe-0b166585860c+22:12294:x1877773344937216:12345-192.168.206.32@tcp:35:umount.0 Request processed in 983us (1242us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1790784517.951121:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 69 00000100:00100000:0.0:1790784517.959112:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784517.959303:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784517.959788:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784517.959922:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344937472 00000100:00100000:2.0:1790784517.959935:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344937472 00000100:00100000:2.0:1790784517.960014:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344937728 00000100:00100000:2.0:1790784517.960018:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344937728 00000100:00100000:2.0:1790784517.960050:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 17 00000100:00100000:2.0:1790784517.960062:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+14:2352:x1877773344937472:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790784517.960081:0:8480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784517.960114:0:8480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945909575400/0x2c3a1e2a079d36bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134ef5 expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784517.960133:0:8480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790784517.960210:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+13:2352:x1877773344937472:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 150us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784517.960218:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 17 00000100:00100000:2.0:1790784517.960242:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 18 00000100:00100000:2.0:1790784517.960248:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+12:2352:x1877773344937728:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790784517.960255:0:8480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784517.960264:0:8480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945907102c00/0x2c3a1e2a079d38ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fc0 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784517.960272:0:8480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790784517.960301:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+11:2352:x1877773344937728:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 52us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784517.960307:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 18 00000100:00100000:0.0:1790784517.963165:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784517.963512:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344937600 00000100:00100000:1.0:1790784517.963534:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344937600 00000100:00100000:2.0:1790784517.963790:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 19 00000100:00100000:2.0:1790784517.963805:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+11:2352:x1877773344937600:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790784517.963824:0:8421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784517.963849:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945907103400/0x2c3a1e2a079d363e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134ebd expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784517.963868:0:8421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790784517.963936:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:2352:x1877773344937600:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 135us (4148us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784517.963945:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 19 00000100:00100000:3.0:1790784517.965857:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344937984 00000100:00100000:3.0:1790784517.965885:0:6669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344937984 00000100:00100000:3.0:1790784517.965944:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 72 00000100:00100000:3.0:1790784517.965954:0:6669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+7:2348:x1877773344937984:12345-192.168.206.32@tcp:9:umount.0 00000020:00000080:3.0:1790784517.965990:0:6669:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d3c18 00000020:00010000:3.0:1790784517.966001:0:6669:0:(genops.c:1920:obd_stale_export_put()) Put export ffff945934917000: total 0 00000100:00080000:3.0:1790784517.966008:0:6669:0:(import.c:65:import_set_state_nolock()) ffff945934916000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790784517.966061:0:6669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:2.0:1790784517.966768:0:5806:0:(genops.c:1906:obd_stale_export_get()) Get export ffff945934917000: total 0 00010000:00010000:2.0:1790784517.966822:0:5806:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff945934917000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1790784517.966893:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9d09eec/0x2c3a1e2a079d3fb4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135195 expref: 7 pid: 8181 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784517.966935:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d4644 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813535c expref: 6 pid: 8181 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784517.966953:0:5806:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff945934917000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1790784517.966966:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784517.966968:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784517.966970:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784517.967271:0:6669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+2:2348:x1877773344937984:12345-192.168.206.32@tcp:9:umount.0 Request processed in 1317us (4117us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784517.967290:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 72 00000100:00100000:0.0:1790784517.973048:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784517.973139:0:8181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344938112 00000100:00100000:2.0:1790784517.973152:0:8181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344938112 00000100:00100000:2.0:1790784517.973241:0:8181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 73 00000100:00100000:2.0:1790784517.973253:0:8181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+5:2348:x1877773344938112:12345-192.168.206.32@tcp:9:umount.0 00000020:00000080:2.0:1790784517.973750:0:8181:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d39b0 00000100:00080000:2.0:1790784517.973765:0:8181:0:(import.c:65:import_set_state_nolock()) ffff94590364c800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790784517.973824:0:8181:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1790784517.974206:0:8181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b0f9e8c2-ddb0-4027-babe-0b166585860c+2:2348:x1877773344938112:12345-192.168.206.32@tcp:9:umount.0 Request processed in 952us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784517.974216:0:8181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 73 00010000:00010000:3.0:1790784517.976433:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784518.007768:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784518.008048:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344939136 00000100:00100000:2.0:1790784518.008062:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344939136 00000100:00100000:2.0:1790784518.008183:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 239 00000100:00100000:2.0:1790784518.008195:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+22:2348:x1877773344939136:12345-192.168.206.32@tcp:39:umount.0 00000020:00000080:2.0:1790784518.008239:0:5819:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d364c 00000020:00010000:2.0:1790784518.008259:0:5819:0:(genops.c:1920:obd_stale_export_put()) Put export ffff94592dae5000: total 0 00000100:00080000:2.0:1790784518.008265:0:5819:0:(import.c:65:import_set_state_nolock()) ffff94592d5d0000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790784518.008301:0:5819:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1790784518.008815:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b0f9e8c2-ddb0-4027-babe-0b166585860c+21:2348:x1877773344939136:12345-192.168.206.32@tcp:39:umount.0 Request processed in 620us (1066us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1790784518.008824:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 239 00000020:00010000:1.0:1790784518.009305:0:5806:0:(genops.c:1906:obd_stale_export_get()) Get export ffff94592dae5000: total 0 00010000:00010000:1.0:1790784518.009312:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784518.009367:0:5806:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff94592dae5000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1790784518.009455:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff945903af2f00) 00010000:00010000:1.0:1790784518.009460:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790784518.009470:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d3916 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fce expref: 20 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784518.009524:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2b00) 00010000:00010000:1.0:1790784518.009527:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790784518.009532:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d4008 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351aa expref: 19 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784518.009556:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff945903af2300) 00010000:00010000:1.0:1790784518.009559:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790784518.009564:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0000/0x2c3a1e2a079d3c73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381350bc expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784518.009578:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff945903af2700) 00010000:00010000:1.0:1790784518.009581:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790784518.009585:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d3e95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135148 expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784518.009602:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94590345d700) 00010000:00010000:1.0:1790784518.009604:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790784518.009608:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75200/0x2c3a1e2a079d4605 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135347 expref: 16 pid: 9249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784518.009621:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff945903af2300) 00010000:00010000:1.0:1790784518.009623:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790784518.009627:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74600/0x2c3a1e2a079d3986 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fea expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784518.009644:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94590345d700) 00010000:00010000:1.0:1790784518.009646:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790784518.009657:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d462f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135355 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784518.009674:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94592012a400) 00010000:00010000:1.0:1790784518.009676:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784518.009680:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945901525800/0x2c3a1e2a079d3932 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fd5 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784518.009698:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94590345dc00) 00010000:00010000:1.0:1790784518.009700:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790784518.009704:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e200/0x2c3a1e2a079d4303 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135283 expref: 12 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784518.009717:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff945903af2700) 00010000:00010000:1.0:1790784518.009719:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790784518.009723:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1e00/0x2c3a1e2a079d3f9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813518e expref: 11 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784518.009735:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94590345d700) 00010000:00010000:1.0:1790784518.009738:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790784518.009741:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b1a00/0x2c3a1e2a079d4525 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813530f expref: 10 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784518.009756:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94590345dc00) 00010000:00010000:1.0:1790784518.009758:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790784518.009762:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4024 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381351b1 expref: 9 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784518.009777:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff945903af2700) 00010000:00010000:1.0:1790784518.009797:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790784518.009803:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0a00/0x2c3a1e2a079d3f75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135180 expref: 8 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784518.009819:0:5806:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff94592dae5000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1790784518.009833:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784518.009834:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784518.009836:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790784518.011017:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790784518.587060:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359595904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790784518.587155:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784518.588004:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359596288:0@lo:400:kworker.0 00000100:00100000:0.0:1790784518.588067:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784518.588096:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790784518.588102:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1877773359596416:0@lo:400:kworker.0 00000100:00100000:0.0:1790784518.588126:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784518.588178:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359596288 00000100:00100000:0.0:1790784518.588187:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359596288 00000100:00100000:0.0:1790784518.588249:0:9249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359596416 00000100:00100000:0.0:1790784518.588253:0:9249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359596416 00000100:00100000:0.0:1790784518.588295:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1790784518.588306:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359596288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784518.588364:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359596288:12345-0@lo:400:kworker.0 Request processed in 60us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784518.588394:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1790784518.588416:0:9249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1790784518.588422:0:9249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1877773359596416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784518.588451:0:9249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1877773359596416:12345-0@lo:400:kworker.0 Request processed in 30us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784518.588457:0:9249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:0.0:1790784518.588480:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790784518.588532:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1877773359596416:0@lo:400:kworker.0 00000100:00100000:0.0:1790784518.588544:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359596288:0@lo:400:kworker.0 00000100:00100000:1.0:1790784518.588949:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359595904 00000100:00100000:1.0:1790784518.588956:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359595904 00000100:00100000:1.0:1790784518.588997:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790784518.589005:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590685f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359595904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790784518.589039:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790784518.589089:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590685f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359595904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (1934us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784518.589095:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1790784518.589151:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790784518.589191:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359595904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790784518.589290:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1877773359596160:0@lo:400:kworker.0 00000100:00100000:3.0:1790784518.589328:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784518.589358:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1790784518.589364:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359596032:0@lo:400:kworker.0 00000100:00100000:3.0:1790784518.589412:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784518.589439:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359596544:0@lo:400:kworker.0 00000100:00100000:3.0:1790784518.589463:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784518.589667:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359596032 00000100:00100000:3.0:1790784518.589673:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359596032 00000100:00100000:3.0:1790784518.589713:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1790784518.589721:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3282:x1877773359596032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784518.589868:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359596544 00000100:00100000:0.0:1790784518.589871:0:6668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359596544 00000100:00100000:0.0:1790784518.589905:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790784518.589912:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359596544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784518.589953:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359596544:12345-0@lo:400:kworker.0 Request processed in 43us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784518.589973:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1790784518.589989:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790784518.590001:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359596160 00000100:00100000:0.0:1790784518.590004:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359596160 00000100:00100000:0.0:1790784518.590025:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1790784518.590031:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1877773359596160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784518.590060:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1877773359596160:12345-0@lo:400:kworker.0 Request processed in 30us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784518.590066:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1790784518.590143:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3282:x1877773359596032:12345-0@lo:400:kworker.0 Request processed in 423us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784518.590150:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1790784518.590192:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359596032:0@lo:400:kworker.0 00000100:00100000:3.0:1790784518.590203:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359596544:0@lo:400:kworker.0 00000100:00100000:3.0:1790784518.590211:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1877773359596160:0@lo:400:kworker.0 00010000:00010000:3.0:1790784518.653195:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784519.103929:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d344e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359596672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790784519.104026:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784519.104124:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359596672 00000100:00100000:2.0:1790784519.104134:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359596672 00000100:00100000:2.0:1790784519.104187:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790784519.104198:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590685dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359596672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790784519.104245:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790784519.104296:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590685dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359596672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784519.104304:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790784519.104360:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d344e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359596672:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1790784519.166566:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:0.0:1790784519.166599:0:5841:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b0f9e8c2-ddb0-4027-babe-0b166585860c 00000001:00080000:0.0:1790784519.166607:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1790784519.166625:0:5841:0:(genops.c:885:class_export_put()) final put ffff94592dae5000/b0f9e8c2-ddb0-4027-babe-0b166585860c 00000020:00000080:2.0:1790784519.166723:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94592dae5000/b0f9e8c2-ddb0-4027-babe-0b166585860c for lustre-MDT0000 00000020:00000080:2.0:1790784519.166811:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94592d5d0000 for lustre-MDT0000 00000001:00100000:3.0:1790784519.197194:0:7614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b0f9e8c2-ddb0-4027-babe-0b166585860c 00000020:00000080:3.0:1790784519.197207:0:7614:0:(genops.c:885:class_export_put()) final put ffff945934917000/b0f9e8c2-ddb0-4027-babe-0b166585860c 00000020:00000080:3.0:1790784519.197237:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff945934917000/b0f9e8c2-ddb0-4027-babe-0b166585860c for lustre-OST0001 00000020:00000080:3.0:1790784519.197302:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff945934916000 for lustre-OST0001 00010000:00010000:1.0:1790784519.675169:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784520.538640:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784520.538690:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784520.538737:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784520.538778:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344939264 00000100:00100000:0.0:1790784520.538790:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344939264 00000100:00100000:0.0:1790784520.538854:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344939520 00000100:00100000:0.0:1790784520.538857:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344939520 00000100:00100000:0.0:1790784520.538874:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344939392 00000100:00100000:0.0:1790784520.538877:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344939392 00000100:00100000:0.0:1790784520.538893:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 20 00000100:00100000:0.0:1790784520.538903:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+12:2351:x1877773344939264:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790784520.538922:0:8421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784520.538944:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94590955ec00/0x2c3a1e2a079d371e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f0a expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784520.538995:0:8421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790784520.539057:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+11:2351:x1877773344939264:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 154us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784520.539065:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 20 00000100:00100000:0.0:1790784520.539084:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 21 00000100:00100000:0.0:1790784520.539091:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+10:2351:x1877773344939520:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790784520.539100:0:8421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784520.539109:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945907102000/0x2c3a1e2a079d38e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134fb9 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784520.539118:0:8421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790784520.539133:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+9:2351:x1877773344939520:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 43us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784520.539145:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 21 00000100:00100000:0.0:1790784520.539159:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 22 00000100:00100000:0.0:1790784520.539165:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905107c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+8:2351:x1877773344939392:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790784520.539173:0:8421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784520.539181:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94590955ea00/0x2c3a1e2a079d3725 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134f34 expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784520.539190:0:8421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790784520.539208:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905107c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+7:2351:x1877773344939392:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 43us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784520.539220:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 22 00000100:00100000:0.0:1790784520.553516:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784520.553854:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344939776 00000100:00100000:1.0:1790784520.553868:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344939776 00000100:00100000:1.0:1790784520.553958:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 240 00000100:00100000:1.0:1790784520.553970:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+6:2348:x1877773344939776:12345-192.168.206.32@tcp:39:umount.0 00000020:00000080:1.0:1790784520.554022:0:5819:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d3733 00000020:00010000:1.0:1790784520.554032:0:5819:0:(genops.c:1920:obd_stale_export_put()) Put export ffff945905049000: total 0 00000100:00080000:1.0:1790784520.554039:0:5819:0:(import.c:65:import_set_state_nolock()) ffff94590504d800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790784520.554076:0:5819:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:2.0:1790784520.554974:0:5805:0:(genops.c:1906:obd_stale_export_get()) Get export ffff945905049000: total 0 00010000:00010000:2.0:1790784520.555043:0:5805:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff945905049000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1790784520.555106:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2b00) 00010000:00010000:2.0:1790784520.555111:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790784520.555124:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4652 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135363 expref: 7 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784520.555153:0:5805:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff945905049000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1790784520.555164:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784520.555166:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784520.555168:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790784520.555340:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8+3:2348:x1877773344939776:12345-192.168.206.32@tcp:39:umount.0 Request processed in 1369us (1854us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1790784520.555356:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 240 00000100:00080000:0.0:1790784520.555469:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790784520.586144:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784520.586360:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344940032 00000100:00100000:3.0:1790784520.586413:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344940032 00000100:00100000:3.0:1790784520.586475:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 304 00000100:00100000:3.0:1790784520.586498:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+7:2348:x1877773344940032:12345-192.168.206.32@tcp:251:umount.0 00000020:00000080:3.0:1790784520.586806:0:5810:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d3629 00000020:00010000:3.0:1790784520.586817:0:5810:0:(genops.c:1920:obd_stale_export_put()) Put export ffff94592d5d4000: total 0 00000100:00080000:3.0:1790784520.586823:0:5810:0:(import.c:65:import_set_state_nolock()) ffff94592d5d6000 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1790784520.586989:0:5806:0:(genops.c:1906:obd_stale_export_get()) Get export ffff94592d5d4000: total 0 00010000:00010000:1.0:1790784520.586994:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784520.587052:0:5806:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff94592d5d4000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1790784520.587089:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945907102200/0x2c3a1e2a079d36df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838134efc expref: 3 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784520.587109:0:5806:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff94592d5d4000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1790784520.587118:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784520.587119:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784520.587121:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784520.587201:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ca9b063-fa51-4809-8e8c-f4ded37a88b1+1:2348:x1877773344940032:12345-192.168.206.32@tcp:251:umount.0 Request processed in 715us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784520.587211:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 304 00000020:00000080:3.0:1790784520.587225:0:5810:0:(genops.c:885:class_export_put()) final put ffff94592d5d4000/0ca9b063-fa51-4809-8e8c-f4ded37a88b1 00000020:00000080:2.0:1790784520.593091:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94592d5d4000/0ca9b063-fa51-4809-8e8c-f4ded37a88b1 for MGS 00000020:00000080:2.0:1790784520.593196:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94592d5d6000 for MGS 00010000:00010000:2.0:1790784520.700049:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790784520.713843:0:6693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b0f9e8c2-ddb0-4027-babe-0b166585860c 00000020:00000080:0.0:1790784520.713855:0:6693:0:(genops.c:885:class_export_put()) final put ffff94590364b800/b0f9e8c2-ddb0-4027-babe-0b166585860c 00000020:00000080:1.0:1790784520.713935:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94590364b800/b0f9e8c2-ddb0-4027-babe-0b166585860c for lustre-OST0000 00000020:00000080:1.0:1790784520.713995:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94590364c800 for lustre-OST0000 00010000:00010000:2.0:1790784521.727137:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790784522.547261:0:12937:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1790784522.557965:0:12937:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1790784522.558025:0:12937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff94590955fc00/0x2c3a1e2a079d36ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d36b5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784522.558041:0:12937:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff94590955fc00/0x2c3a1e2a079d36ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d36b5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784522.558049:0:12937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff94590955fc00/0x2c3a1e2a079d36ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2c3a1e2a079d36b5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784522.558060:0:12937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.132@tcp lock: ffff94590955fc00/0x2c3a1e2a079d36ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2c3a1e2a079d36b5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784522.558085:0:12937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790784522.558090:0:12937:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1790784522.558119:0:12937:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790784522.558123:0:12937:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790784522.558129:0:12937:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790784522.558152:0:12937:0:(import.c:65:import_set_state_nolock()) ffff9459051b2800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1790784522.558925:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3278:1877773359596800:0@lo:39:umount.0 00000100:00100000:0.0:1790784522.558992:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790784522.559194:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790784522.559202:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff94590955fc00/0x2c3a1e2a079d36ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2c3a1e2a079d36b5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784522.559211:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955fc00 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:2.0:1790784522.559215:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff94590955fc00/0x2c3a1e2a079d36ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2c3a1e2a079d36b5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784522.559224:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff94590955fc00/0x2c3a1e2a079d36ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x2c3a1e2a079d36b5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790784522.559232:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff94590955fc00/0x2c3a1e2a079d36ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x2c3a1e2a079d36b5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790784522.559237:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790784522.559240:0:5805:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790784522.559242:0:5805:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790784522.559282:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff94590955fc00/0x2c3a1e2a079d36ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2c3a1e2a079d36b5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784522.559289:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790784522.559325:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff94590955fc00/0x2c3a1e2a079d36ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2c3a1e2a079d36b5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784522.559481:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff94590955fc00/0x2c3a1e2a079d36ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2c3a1e2a079d36b5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784522.559509:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784522.559511:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784522.559513:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784522.559536:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790784522.559547:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590685c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3280:1877773359596928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790784522.559594:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784522.559595:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359596800 00000100:00100000:1.0:1790784522.559603:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359596800 00000100:00100000:1.0:1790784522.559654:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1790784522.559664:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1877773359596800:12345-0@lo:39:umount.0 00000020:00000080:1.0:1790784522.559796:0:5818:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d3446 00000100:00080000:1.0:1790784522.559805:0:5818:0:(import.c:65:import_set_state_nolock()) ffff94593beda000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1790784522.559878:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3278:x1877773359596800:12345-0@lo:39:umount.0 Request processed in 216us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784522.559886:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:1.0:1790784522.559895:0:5818:0:(genops.c:885:class_export_put()) final put ffff94593bede800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:0.0:1790784522.559912:0:3278:0:(import.c:65:import_set_state_nolock()) ffff9459051b2800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:1.0:1790784522.559917:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94593bede800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:0.0:1790784522.559922:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3278:1877773359596800:0@lo:39:umount.0 00000020:00000080:1.0:1790784522.559951:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94593beda000 for lustre-MDT0000 00000100:00080000:1.0:1790784522.559965:0:12937:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790784522.559967:0:12937:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790784522.559971:0:12937:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1790784522.560341:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784522.560579:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359596928 00000100:00100000:2.0:1790784522.560641:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359596928 00000100:00100000:2.0:1790784522.560746:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790784522.560756:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d346a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+19:3280:x1877773359596928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790784522.560769:0:8421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784522.560784:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945907103200/0x2c3a1e2a079d36b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2c3a1e2a079d36ae expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784522.560799:0:8421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790784522.560846:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d346a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:3280:x1877773359596928:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784522.560853:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790784522.560982:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590685c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3280:1877773359596928:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790784522.562174:0:12937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945909574400/0x2c3a1e2a079d36c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d36ca expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784522.562188:0:12937:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945909574400/0x2c3a1e2a079d36c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d36ca expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784522.562196:0:12937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945909574400/0x2c3a1e2a079d36c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x2c3a1e2a079d36ca expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784522.562204:0:12937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.132@tcp lock: ffff945909574400/0x2c3a1e2a079d36c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x2c3a1e2a079d36ca expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784522.562278:0:12937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790784522.562285:0:12937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff94590955f600/0x2c3a1e2a079d35e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d35ea expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784522.562291:0:12937:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff94590955f600/0x2c3a1e2a079d35e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d35ea expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784522.562297:0:12937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff94590955f600/0x2c3a1e2a079d35e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2c3a1e2a079d35ea expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784522.562302:0:12937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.132@tcp lock: ffff94590955f600/0x2c3a1e2a079d35e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2c3a1e2a079d35ea expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784522.562446:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790784522.562453:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff945909574400/0x2c3a1e2a079d36c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2c3a1e2a079d36ca expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784522.562461:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945909574400 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:2.0:1790784522.562470:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff945909574400/0x2c3a1e2a079d36c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2c3a1e2a079d36ca expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784522.562478:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff945909574400/0x2c3a1e2a079d36c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x2c3a1e2a079d36ca expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790784522.562484:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff945909574400/0x2c3a1e2a079d36c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x2c3a1e2a079d36ca expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790784522.562500:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790784522.562503:0:5805:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1790784522.562528:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff945909574400/0x2c3a1e2a079d36c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2c3a1e2a079d36ca expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784522.562534:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790784522.562561:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff945909574400/0x2c3a1e2a079d36c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2c3a1e2a079d36ca expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784522.562568:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff945909574400/0x2c3a1e2a079d36c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2c3a1e2a079d36ca expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784522.562578:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790784522.562581:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff94590955f600/0x2c3a1e2a079d35e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2c3a1e2a079d35ea expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784522.562586:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955f600 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:2.0:1790784522.562589:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff94590955f600/0x2c3a1e2a079d35e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2c3a1e2a079d35ea expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784522.562596:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff94590955f600/0x2c3a1e2a079d35e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2c3a1e2a079d35ea expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790784522.562612:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff94590955f600/0x2c3a1e2a079d35e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2c3a1e2a079d35ea expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790784522.562617:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1790784522.562619:0:5805:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1790784522.562632:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff94590955f600/0x2c3a1e2a079d35e3 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2c3a1e2a079d35ea expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784522.562649:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790784522.562665:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff94590955f600/0x2c3a1e2a079d35e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2c3a1e2a079d35ea expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784522.562672:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784522.562674:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784522.562675:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784522.562698:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590685d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359597184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790784522.562748:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784522.562801:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359597184 00000100:00100000:2.0:1790784522.562806:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359597184 00000100:00100000:2.0:1790784522.562846:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790784522.562853:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590685d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+18:3281:x1877773359597184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790784522.562864:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784522.562874:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945907102400/0x2c3a1e2a079d35ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2c3a1e2a079d35e3 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784522.562887:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790784522.562917:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590685d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:3281:x1877773359597184:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784522.562932:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790784522.562966:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590685d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359597184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790784522.563034:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590685c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3280:1877773359597056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790784522.563062:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784522.563138:0:8480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359597056 00000100:00100000:2.0:1790784522.563142:0:8480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359597056 00000100:00100000:2.0:1790784522.563166:0:8480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790784522.563173:0:8480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d344380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+17:3280:x1877773359597056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790784522.563174:0:12937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790784522.563179:0:12937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff94590955f600/0x2c3a1e2a079d35e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2c3a1e2a079d35ea expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784522.563181:0:8480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784522.563189:0:8480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945909575800/0x2c3a1e2a079d36ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2c3a1e2a079d36c3 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790784522.563192:0:12937:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1790784522.563197:0:8480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790784522.563198:0:12937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945907103e00/0x2c3a1e2a079d38d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d38de expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784522.563205:0:12937:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945907103e00/0x2c3a1e2a079d38d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d38de expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784522.563211:0:12937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945907103e00/0x2c3a1e2a079d38d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2c3a1e2a079d38de expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784522.563218:0:12937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.132@tcp lock: ffff945907103e00/0x2c3a1e2a079d38d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2c3a1e2a079d38de expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784522.563220:0:8480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d344380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:3280:x1877773359597056:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784522.563226:0:8480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1790784522.563239:0:12937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790784522.563242:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790784522.563244:0:12937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945909574800/0x2c3a1e2a079d3397 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d339e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784522.563246:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff945907103e00/0x2c3a1e2a079d38d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2c3a1e2a079d38de expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784522.563252:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945907103e00 already unused, calling callback (ffffffffc1bf9c20) 00010000:00010000:1.0:1790784522.563252:0:12937:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945909574800/0x2c3a1e2a079d3397 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d339e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790784522.563256:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff945907103e00/0x2c3a1e2a079d38d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2c3a1e2a079d38de expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784522.563258:0:12937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945909574800/0x2c3a1e2a079d3397 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2c3a1e2a079d339e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784522.563262:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff945907103e00/0x2c3a1e2a079d38d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2c3a1e2a079d38de expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784522.563265:0:12937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.132@tcp lock: ffff945909574800/0x2c3a1e2a079d3397 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2c3a1e2a079d339e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790784522.563268:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff945907103e00/0x2c3a1e2a079d38d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2c3a1e2a079d38de expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784522.563271:0:12937:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790784522.563274:0:12937:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1790784522.563276:0:12937:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 10000000:01000000:2.0:1790784522.563282:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790784522.563284:0:5805:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1790784522.563285:0:5805:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:01000004:1.0:1790784522.563297:0:12937:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00010000:00010000:2.0:1790784522.563298:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff945907103e00/0x2c3a1e2a079d38d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2c3a1e2a079d38de expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:1.0:1790784522.563300:0:12937:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00010000:00010000:2.0:1790784522.563304:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:1.0:1790784522.563304:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790784522.563309:0:12937:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:1.0:1790784522.563313:0:12937:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff94592d5d5800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1790784522.563314:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff945907103e00/0x2c3a1e2a079d38d7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2c3a1e2a079d38de expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790784522.563319:0:12937:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff94593f686000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1790784522.563321:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff945907103e00/0x2c3a1e2a079d38d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2c3a1e2a079d38de expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790784522.563325:0:12937:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff945905049000 65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8 192.168.206.32@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1790784522.563329:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790784522.563332:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff945909574800/0x2c3a1e2a079d3397 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2c3a1e2a079d339e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784522.563338:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945909574800 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:2.0:1790784522.563340:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff945909574800/0x2c3a1e2a079d3397 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2c3a1e2a079d339e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784522.563347:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff945909574800/0x2c3a1e2a079d3397 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2c3a1e2a079d339e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790784522.563352:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff945909574800/0x2c3a1e2a079d3397 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2c3a1e2a079d339e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790784522.563357:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1790784522.563359:0:5805:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1790784522.563360:0:5805:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1790784522.563394:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff945909574800/0x2c3a1e2a079d3397 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2c3a1e2a079d339e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784522.563400:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790784522.563407:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff945909574800/0x2c3a1e2a079d3397 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2c3a1e2a079d339e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784522.563413:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff945909574800/0x2c3a1e2a079d3397 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2c3a1e2a079d339e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784522.563423:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784522.563425:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784522.563427:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784522.563435:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590685d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359597312:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1790784522.563455:0:12937:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff94592a9a19c0) has exports, disconnecting them 00000100:00100000:2.0:1790784522.563459:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1790784522.563459:0:12937:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff94592d5d5800), last request at 1790784518 00000020:00000080:1.0:1790784522.563465:0:12937:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d35ab 00000100:00080000:1.0:1790784522.563478:0:12937:0:(import.c:65:import_set_state_nolock()) ffff94592d5d2000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1790784522.563501:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359597312 00000100:00100000:2.0:1790784522.563505:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359597312 00000100:00100000:2.0:1790784522.563529:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000020:00080000:1.0:1790784522.563531:0:12937:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff94592d5d5800): rc 0 00000020:00000080:1.0:1790784522.563534:0:12937:0:(genops.c:885:class_export_put()) final put ffff94592d5d5800/lustre-MDT0000-lwp-OST0001_UUID 00000100:00100000:2.0:1790784522.563535:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+16:3282:x1877773359597312:12345-0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1790784522.563541:0:12937:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff94593f686000), last request at 1790784518 00010000:00010000:2.0:1790784522.563542:0:8421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:1.0:1790784522.563544:0:12937:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d34e0 00000100:00080000:1.0:1790784522.563549:0:12937:0:(import.c:65:import_set_state_nolock()) ffff94593f684000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1790784522.563550:0:8421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945907102e00/0x2c3a1e2a079d38de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2c3a1e2a079d38d7 expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790784522.563555:0:12937:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff94593f686000): rc 0 00000020:00000080:1.0:1790784522.563557:0:12937:0:(genops.c:885:class_export_put()) final put ffff94593f686000/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:2.0:1790784522.563559:0:8421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00000080:1.0:1790784522.563563:0:12937:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffae2cc2cabae0 00000100:00080000:1.0:1790784522.563579:0:12937:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790784522.563582:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:3282:x1877773359597312:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784522.563582:0:12937:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000100:00100000:2.0:1790784522.563588:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:1.0:1790784522.563592:0:12937:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790784522.563609:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590685d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3282:1877773359597312:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790784522.563622:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784522.563676:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790784522.563683:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94592d5d5800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1790784522.563732:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94593f686000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1790784522.563764:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94592d5d2000 for lustre-MDT0000 00000020:00000080:3.0:1790784522.563768:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94593f684000 for lustre-MDT0000 00000100:00080000:1.0:1790784522.563770:0:12937:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1790784522.563782:0:12937:0:(import.c:65:import_set_state_nolock()) ffff94592da6d800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1790784522.563792:0:12937:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1790784522.563795:0:12937:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000100:00100000:3.0:1790784522.563796:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590685c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3280:1877773359597056:0@lo:103:ldlm_bl.0 00000004:00080000:1.0:1790784522.563804:0:12937:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790784522.563809:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790784522.563814:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3280:1877773359597440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790784522.563834:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784522.563858:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359597440 00000100:00100000:3.0:1790784522.563861:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359597440 00000100:00080000:1.0:1790784522.563862:0:12937:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1790784522.563869:0:12937:0:(import.c:65:import_set_state_nolock()) ffff945935eff800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1790784522.563885:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790784522.563891:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d347b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+15:3280:x1877773359597440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790784522.563898:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784522.563906:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945900030800/0x2c3a1e2a079d339e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2c3a1e2a079d3397 expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784522.563918:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790784522.563943:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d347b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:3280:x1877773359597440:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784522.563949:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790784522.563974:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3280:1877773359597440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790784522.564099:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1877773359597568:0@lo:9:umount.0 00000100:00100000:0.0:1790784522.564131:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1790784522.564164:0:12937:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff94592a9a19c0) has no exports 00000100:00100000:0.0:1790784522.564189:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1877773359597696:0@lo:9:umount.0 00000100:00100000:0.0:1790784522.564208:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784522.566456:0:8181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359597568 00000100:00100000:1.0:1790784522.566468:0:8181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359597568 00000100:00100000:1.0:1790784522.566534:0:8181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359597696 00000100:00100000:1.0:1790784522.566537:0:8181:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359597696 00000100:00100000:1.0:1790784522.566560:0:8181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790784522.566570:0:8181:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1877773359597568:12345-0@lo:9:umount.0 00000020:00000080:1.0:1790784522.566598:0:8181:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d352d 00000100:00080000:1.0:1790784522.566606:0:8181:0:(import.c:65:import_set_state_nolock()) ffff94593fa9e800 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1790784522.566641:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790784522.566645:0:5814:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:1.0:1790784522.566649:0:8181:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1790784522.566655:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790784522.566662:0:6668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1877773359597696:12345-0@lo:9:umount.0 00000020:00000080:0.0:1790784522.566678:0:6668:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d3614 00000100:00080000:0.0:1790784522.566684:0:6668:0:(import.c:65:import_set_state_nolock()) ffff945935df2800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790784522.566759:0:6668:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1790784522.567044:0:6668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3278:x1877773359597696:12345-0@lo:9:umount.0 Request processed in 383us (2834us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784522.567050:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:0.0:1790784522.567077:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790784522.567104:0:3278:0:(import.c:65:import_set_state_nolock()) ffff945935eff800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1790784522.567116:0:3278:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1790784522.567118:0:3278:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790784522.567121:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1877773359597696:0@lo:9:umount.0 00010000:00010000:2.0:1790784522.567268:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790784522.569354:0:8181:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3278:x1877773359597568:12345-0@lo:9:umount.0 Request processed in 2780us (5216us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784522.569398:0:8181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1790784522.570332:0:3278:0:(import.c:65:import_set_state_nolock()) ffff94592da6d800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1790784522.570347:0:3278:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1790784522.570438:0:3278:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790784522.570506:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1877773359597568:0@lo:9:umount.0 00000020:00080000:1.0:1790784522.574061:0:12937:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff94592a9a19c0) has no exports 00000020:00000080:1.0:1790784522.623953:0:12937:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d33f2 00000020:00000080:1.0:1790784522.623968:0:12937:0:(genops.c:885:class_export_put()) final put ffff94593c4ae800/lustre-QMT0000_UUID 00000020:01000000:1.0:1790784522.623992:0:12937:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1790784522.624275:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94593c4ae800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1790784522.624362:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790784522.624372:0:12937:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790784522.624463:0:12937:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff945935d70000) has no exports 00000020:00000080:0.0:1790784522.624824:0:12937:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d33eb 00000020:00000080:0.0:1790784522.624830:0:12937:0:(genops.c:885:class_export_put()) final put ffff945935d6b800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790784522.624903:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff945935d6b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790784522.624969:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790784522.624977:0:12937:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1790784522.624980:0:12937:0:(genops.c:885:class_export_put()) final put ffff945935d68000/lustre-QMT0000_UUID 00000020:00000080:0.0:1790784522.624982:0:12937:0:(genops.c:844:class_export_destroy()) destroying export ffff945935d68000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1790784522.624990:0:12937:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1790784522.769106:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784523.706726:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790784523.706734:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1877773359598080:0@lo:400:kworker.0 00000100:00100000:0.0:1790784523.706760:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359597824:0@lo:400:kworker.0 00000100:00100000:2.0:1790784523.706807:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784523.706893:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359598080 00000100:00100000:3.0:1790784523.706900:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359598080 00000100:00100000:3.0:1790784523.706943:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1790784523.706951:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3282:x1877773359598080:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1790784523.706959:0:5820:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1790784523.707124:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359597952:0@lo:400:kworker.0 00000100:00100000:0.0:1790784523.717023:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784523.717515:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359597824 00000100:00100000:0.0:1790784523.717527:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359597824 00000100:00100000:0.0:1790784523.718047:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1790784523.718066:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945903692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:3279:x1877773359597824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784523.718178:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945903692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d3e7b7e5-0721-4246-a3a0-5d40e18144b6+14:3279:x1877773359597824:12345-0@lo:400:kworker.0 Request processed in 120us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784523.718186:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1790784523.718279:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359597824:0@lo:400:kworker.0 00000100:00100000:3.0:1790784523.721515:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3282:x1877773359598080:12345-0@lo:400:kworker.0 Request processed in 14554us (14700us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790784523.721547:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1790784523.724331:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784523.724564:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359597952 00000100:00100000:3.0:1790784523.724574:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359597952 00000100:00100000:3.0:1790784523.724618:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1790784523.724626:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592daa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3281:x1877773359597952:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1790784523.724634:0:5818:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1790784523.724676:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592daa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3281:x1877773359597952:12345-0@lo:400:kworker.0 Request processed in 50us (350us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790784523.724682:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:1.0:1790784523.725117:0:3281:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790784523.725122:0:3281:0:(import.c:65:import_set_state_nolock()) ffff94593f687000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1790784523.725126:0:3281:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1790784523.731811:0:3282:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1790784523.731818:0:3282:0:(import.c:65:import_set_state_nolock()) ffff945935df6800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1790784523.731823:0:3282:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1790784523.731829:0:3282:0:(import.c:65:import_set_state_nolock()) ffff945935df6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790784523.731833:0:3282:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 163 00000100:00080000:2.0:1790784523.731844:0:3282:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff945935df6800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:2.0:1790784523.731881:0:3282:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94592d9cca80 x1877773359598208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790784523.731926:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3282:1877773359598080:0@lo:400:kworker.0 00000100:00100000:0.0:1790784523.732070:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3278:1877773359598208:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1790784523.732135:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784523.732438:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359598208 00000100:00100000:2.0:1790784523.732447:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359598208 00000100:00100000:2.0:1790784523.732498:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1790784523.732505:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3278:x1877773359598208:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1790784523.732520:0:5819:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1790784523.735589:0:3281:0:(import.c:65:import_set_state_nolock()) ffff94593f687000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790784523.735598:0:3281:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 145 00000100:00080000:1.0:1790784523.735610:0:3281:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff94593f687000 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:1.0:1790784523.735744:0:3281:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94592daa3480 x1877773359598336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790784523.735782:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359597952:0@lo:400:kworker.0 00000100:00100000:0.0:1790784523.735948:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3278:1877773359598336:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1790784523.736008:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784523.736127:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359598336 00000100:00100000:3.0:1790784523.736135:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359598336 00000100:00100000:3.0:1790784523.736167:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1790784523.736173:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3278:x1877773359598336:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1790784523.736188:0:5818:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1790784523.736234:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3278:x1877773359598336:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 61us (226us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790784523.736241:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:0.0:1790784523.736517:0:3278:0:(import.c:65:import_set_state_nolock()) ffff94593f687000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790784523.736531:0:3278:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790784523.736534:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3278:1877773359598336:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1790784523.760536:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3278:x1877773359598208:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 28010us (28381us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790784523.760551:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:0.0:1790784523.762109:0:3278:0:(import.c:65:import_set_state_nolock()) ffff945935df6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790784523.762118:0:3278:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790784523.762122:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3278:1877773359598208:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:2.0:1790784523.770754:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790784524.294442:0:7614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790784524.294451:0:7614:0:(genops.c:885:class_export_put()) final put ffff945935df6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790784524.298108:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff945935df6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1790784524.298178:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff945935df2800 for lustre-OST0001 00000001:00100000:1.0:1790784524.300890:0:5841:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8 00000001:00080000:1.0:1790784524.300905:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1790784524.300910:0:5841:0:(genops.c:885:class_export_put()) final put ffff945905049000/65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8 00000020:00000080:3.0:1790784524.300972:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff945905049000/65d1c5c1-0eef-4ddc-a6c6-6ed1f4a990a8 for lustre-MDT0000 00000020:00000080:3.0:1790784524.301024:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94590504d800 for lustre-MDT0000 00000020:01000000:0.0:1790784524.666604:0:12937:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94590644c180 - data ffff94590f811360/ffff9459070f1800 00000020:01000000:0.0:1790784524.666751:0:12937:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff945903fe0ae0 - data ffff9459297c1870/ffff94593beb4c00 00000001:00000004:0.0:1790784524.672920:0:12937:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:3.0:1790784524.785361:0:12937:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790784524.785370:0:12937:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1790784524.785586:0:12937:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790784524.785589:0:12937:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790784524.787486:0:6775:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790784524.787492:0:6775:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1790784524.787505:0:6775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1790784524.789554:0:12937:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790784524.789562:0:12937:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1790784524.789575:0:12937:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790784524.789589:0:12937:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790784524.790140:0:8112:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790784524.790145:0:8112:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1790784524.790154:0:8112:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00010000:00010000:0.0:1790784524.798529:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790784524.828798:0:12937:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d33ba 00000020:00000080:0.0:1790784524.828809:0:12937:0:(genops.c:885:class_export_put()) final put ffff94592c22c000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790784524.829726:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94592c22c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790784524.830295:0:12937:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d33cf 00000020:00000080:0.0:1790784524.830303:0:12937:0:(genops.c:885:class_export_put()) final put ffff94593c4aa000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1790784524.830360:0:12937:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1790784524.830366:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790784524.830402:0:12937:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790784524.830407:0:12937:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff94592a9a4d40) has no exports 00000004:01000000:0.0:1790784524.830669:0:12937:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1790784524.830679:0:12937:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d360d 00000020:00000080:0.0:1790784524.830685:0:12937:0:(genops.c:885:class_export_put()) final put ffff945907c64800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790784524.831055:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94593c4aa000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1790784524.831150:0:12937:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1790784524.831228:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff945907c64800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1790784524.831260:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790784524.831270:0:12937:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790784524.831274:0:12937:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff94593c4a4d40) has no exports 00000020:00000080:3.0:1790784524.831284:0:12937:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d3606 00000020:00000080:3.0:1790784524.831290:0:12937:0:(genops.c:885:class_export_put()) final put ffff945935efb800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1790784524.831951:0:12937:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1790784524.831957:0:12937:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790784524.831961:0:12937:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1790784524.831967:0:12937:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790784524.831969:0:12937:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790784524.832393:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff945935efb800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790784524.832639:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790784524.832650:0:12937:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790784524.832657:0:12937:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d3526 00000020:00000080:3.0:1790784524.832664:0:12937:0:(genops.c:885:class_export_put()) final put ffff94593f686800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1790784524.832669:0:12937:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1790784524.832674:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790784524.832678:0:12937:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790784524.832681:0:12937:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff945935d73380) has no exports 00000020:00000080:3.0:1790784524.832686:0:12937:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d351f 00000020:00000080:3.0:1790784524.832689:0:12937:0:(genops.c:885:class_export_put()) final put ffff94593f624000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1790784524.833005:0:12937:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1790784524.833008:0:12937:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790784524.833011:0:12937:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1790784524.833016:0:12937:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790784524.833018:0:12937:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790784524.833043:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790784524.833048:0:12937:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790784524.833073:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790784524.833077:0:12937:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790784524.833081:0:12937:0:(genops.c:885:class_export_put()) final put ffff94592c22e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790784524.833083:0:12937:0:(genops.c:844:class_export_destroy()) destroying export ffff94592c22e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1790784524.833103:0:12937:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790784524.833222:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff945935eff800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1790784524.833235:0:8:0:(genops.c:885:class_export_put()) final put ffff94593f682000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790784524.833237:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94593f682000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1790784524.833241:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790784524.833294:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94593f686800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1790784524.833299:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94593f624000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790784524.833303:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94592da6d800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1790784524.833307:0:8:0:(genops.c:885:class_export_put()) final put ffff94593f623800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790784524.833308:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94593f623800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1790784524.833313:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790784524.833965:0:12937:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d33d6 00000020:00000080:3.0:1790784524.833973:0:12937:0:(genops.c:885:class_export_put()) final put ffff94593c4ad800/lustre-MDD0000_UUID 00000020:01000000:3.0:1790784524.833991:0:12937:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1790784524.833996:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790784524.834001:0:12937:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790784524.834004:0:12937:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff94593c4a19c0) has no exports 00000020:00000080:3.0:1790784524.834024:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790784524.834028:0:12937:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1790784524.834031:0:12937:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d33dd 00000020:00000080:3.0:1790784524.834035:0:12937:0:(genops.c:885:class_export_put()) final put ffff94593c4ab800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1790784524.834042:0:12937:0:(tgt_mount.c:187:server_put_mount()) put mount ffff945905fd5000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1790784524.834045:0:12937:0:(obd_mount.c:710:lustre_put_lsi()) put ffff945905fd5000 3 00000020:01000004:3.0:1790784524.834048:0:12937:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff945905fd5000 from lustre-MDT0000 00000020:00000080:3.0:1790784524.834065:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790784524.834069:0:12937:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1790784524.834072:0:12937:0:(genops.c:885:class_export_put()) final put ffff94592c229800/lustre-MDT0000_UUID 00000020:00000080:3.0:1790784524.834074:0:12937:0:(genops.c:844:class_export_destroy()) destroying export ffff94592c229800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1790784524.834080:0:12937:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1790784524.834109:0:12937:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1790784524.834113:0:12937:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1790784524.834116:0:12937:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1790784524.834119:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790784524.834121:0:12937:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790784524.834127:0:12937:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff945905724000 d3e7b7e5-0721-4246-a3a0-5d40e18144b6 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790784524.834132:0:12937:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff94592a9a0000) has exports, disconnecting them 00000020:00080000:3.0:1790784524.834136:0:12937:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff945905724000), last request at 1790784292 00000020:00000080:3.0:1790784524.834163:0:12937:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d337b 00000020:00010000:3.0:1790784524.834168:0:12937:0:(genops.c:1920:obd_stale_export_put()) Put export ffff945905724000: total 2 00000100:00080000:3.0:1790784524.834172:0:12937:0:(import.c:65:import_set_state_nolock()) ffff945905726000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1790784524.834184:0:12937:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff945905724000): rc 0 00000020:00080000:3.0:1790784524.834188:0:12937:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff94592a9a0000) has no exports 00000100:00100000:3.0:1790784524.834245:0:5810:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff945907cdbe00:5810] 0 exiting: rc = 1 00000100:00100000:3.0:1790784524.834329:0:5812:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff9459067c5600:5812] 2 exiting: rc = 0 00000100:00100000:3.0:1790784524.834410:0:5811:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff9459067c5400:5811] 1 exiting: rc = 0 00000100:00100000:3.0:1790784524.834460:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834487:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834496:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834501:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834507:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834514:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834530:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834535:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834541:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834547:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834552:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834557:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834564:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834569:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834575:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834581:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834587:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834593:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834599:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834604:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834610:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834616:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834622:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834628:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834634:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834640:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834646:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834652:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834658:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834664:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834671:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834687:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834693:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834698:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834703:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834709:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834715:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834720:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834727:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834732:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834739:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834745:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834751:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834757:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834763:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834770:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834777:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834783:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834788:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834793:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834799:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834804:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834810:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834815:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834821:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834826:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834831:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834837:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834843:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834849:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834855:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834860:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834865:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.834871:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1790784524.835268:0:12937:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1790784524.835273:0:12937:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:1.0:1790784524.836277:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94593c4ad800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1790784524.836286:0:8:0:(genops.c:885:class_export_put()) final put ffff94592c22f000/lustre-MDD0000_UUID 00000020:00000080:1.0:1790784524.836289:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94592c22f000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1790784524.836294:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1790784524.836471:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94593c4ab800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:0.0:1790784524.837437:0:5805:0:(genops.c:1906:obd_stale_export_get()) Get export ffff945905724000: total 0 00010000:00010000:0.0:1790784524.837487:0:5805:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff945905724000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1790784524.837666:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94590955ee00/0x2c3a1e2a079d3699 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2c3a1e2a079d3692 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784524.837691:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945907103a00/0x2c3a1e2a079d368b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2c3a1e2a079d3684 expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784524.837702:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945907103600/0x2c3a1e2a079d36d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2c3a1e2a079d36d1 expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784524.837712:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945909574c00/0x2c3a1e2a079d36a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2c3a1e2a079d36a0 expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784524.837724:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94593fe74a00/0x2c3a1e2a079d38c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2c3a1e2a079d38bb expref: 5 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784524.837736:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945907102800/0x2c3a1e2a079d38d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2c3a1e2a079d38c9 expref: 4 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784524.837751:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945901524a00/0x2c3a1e2a079d3493 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2c3a1e2a079d348c expref: 3 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784524.837763:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945907102a00/0x2c3a1e2a079d367d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2c3a1e2a079d3676 expref: 2 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784524.837773:0:5805:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff945905724000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1790784524.837787:0:5805:0:(genops.c:885:class_export_put()) final put ffff945905724000/d3e7b7e5-0721-4246-a3a0-5d40e18144b6 00010000:00010000:0.0:1790784524.837812:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784524.837814:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784524.837816:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790784524.837866:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff945905724000/d3e7b7e5-0721-4246-a3a0-5d40e18144b6 for MGS 00000020:00000080:1.0:1790784524.837900:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff945905726000 for MGS 00000020:01000000:0.0:1790784524.839927:0:12937:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94590644c660 - data ffff9458014425e8/ffff945935deb400 00000020:01000000:0.0:1790784524.840061:0:12937:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94592a984cc0 - data ffff94590f827bd0/ffff9459051a9800 00000020:00000080:0.0:1790784524.840835:0:12937:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d335f 00000020:00000080:0.0:1790784524.840842:0:12937:0:(genops.c:885:class_export_put()) final put ffff945905fd2800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1790784524.840863:0:12937:0:(tgt_mount.c:187:server_put_mount()) put mount ffff945905fd5000 from MGS, refs=2 00000020:01000004:0.0:1790784524.840867:0:12937:0:(obd_mount.c:710:lustre_put_lsi()) put ffff945905fd5000 2 00000020:01000004:0.0:1790784524.840870:0:12937:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff945905fd5000 from MGS 00000020:00000080:0.0:1790784524.840894:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790784524.840901:0:12937:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1790784524.840904:0:12937:0:(genops.c:885:class_export_put()) final put ffff945905fd3800/MGS 00000020:00000080:0.0:1790784524.840906:0:12937:0:(genops.c:844:class_export_destroy()) destroying export ffff945905fd3800/MGS for MGS 00000020:01000000:0.0:1790784524.840913:0:12937:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1790784524.840965:0:12937:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1790784524.840970:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790784524.840975:0:12937:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790784524.840982:0:12937:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9459051b7000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790784524.840988:0:12937:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff945935d74d40) has exports, disconnecting them 00000020:00080000:0.0:1790784524.840993:0:12937:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9459051b7000), last request at 1790784293 00000020:00000080:0.0:1790784524.840997:0:12937:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d342a 00000020:00080000:0.0:1790784524.841008:0:12937:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9459051b7000): rc 0 00000020:00000080:0.0:1790784524.841012:0:12937:0:(genops.c:885:class_export_put()) final put ffff9459051b7000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1790784524.841452:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff945905fd2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790784524.841471:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9459051b7000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1790784524.854511:0:12937:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1790784524.854527:0:12937:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790784524.854531:0:12937:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790784524.854539:0:12937:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790784524.854713:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790784524.854722:0:12937:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1790784524.854728:0:12937:0:(obd_mount.c:710:lustre_put_lsi()) put ffff945905fd5000 1 00000020:00000080:1.0:1790784524.854736:0:12937:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d3351 00000020:00000080:1.0:1790784524.854744:0:12937:0:(genops.c:885:class_export_put()) final put ffff945905fd5800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1790784524.854749:0:12937:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1790784524.854754:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790784524.854758:0:12937:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790784524.854761:0:12937:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff94592a9a3380) has no exports 00000020:00000080:3.0:1790784524.855140:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9459051b2800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1790784524.855158:0:36:0:(genops.c:885:class_export_put()) final put ffff945935d80000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1790784524.855161:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff945935d80000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1790784524.855172:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1790784524.855233:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff945905fd5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790784524.887552:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790784524.887567:0:12937:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1790784524.887583:0:12937:0:(genops.c:885:class_export_put()) final put ffff945905fd1000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790784524.887587:0:12937:0:(genops.c:844:class_export_destroy()) destroying export ffff945905fd1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1790784524.887597:0:12937:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1790784524.887720:0:12937:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff945905fd4800 00000020:01000000:1.0:1790784524.887952:0:12937:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1790784524.887956:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790784524.887960:0:12937:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790784524.887964:0:12937:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff94590574b380) has no exports 00000100:00100000:1.0:1790784524.888043:0:9249:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff94590569a000:9249] 3 exiting: rc = 0 00000100:00100000:3.0:1790784524.889187:0:5820:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9459067f9e00:5820] 2 exiting: rc = 0 00000100:00100000:3.0:1790784524.889280:0:5818:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff9459067f8000:5818] 0 exiting: rc = 1 00000100:00100000:2.0:1790784524.889776:0:5819:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9459067f8c00:5819] 1 exiting: rc = 0 00000100:00100000:1.0:1790784524.889908:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.889915:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.889920:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.889924:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.889929:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.889934:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.889938:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.889943:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.889947:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.889953:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.889958:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.889968:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.889975:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.889980:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.889985:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.889990:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.889995:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890090:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890097:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890102:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890108:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890113:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890118:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890135:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890140:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890146:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890151:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890157:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890162:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890168:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890173:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890178:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890184:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890190:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890196:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890201:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890206:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890211:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890216:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890221:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890227:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890232:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890237:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890241:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890258:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890264:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890269:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890274:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890279:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890283:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890289:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890293:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890298:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890303:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890308:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890312:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890317:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890321:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890331:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890336:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890341:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890346:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890352:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.890357:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784524.899269:0:5822:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff945903319a00:5822] 1 exiting: rc = 0 00000100:00100000:3.0:1790784524.899427:0:5821:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff945906b56c00:5821] 0 exiting: rc = 1 00000100:00100000:1.0:1790784524.899645:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.899654:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.899660:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.899674:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.899680:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.899685:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.899693:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.899698:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.899704:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.899710:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.899715:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.899889:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.899900:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.899905:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.899910:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.899915:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.899920:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.899925:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.899929:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.899934:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.899938:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.899942:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.899946:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.899950:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.899954:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.899959:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.899963:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.899968:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.899973:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.899987:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.899992:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.899996:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900001:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900006:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900010:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900015:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900019:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900024:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900028:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900033:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900037:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900042:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900047:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900052:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900058:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900064:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900069:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900074:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900079:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900090:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900097:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900102:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900108:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900113:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900118:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900123:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900128:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900132:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900137:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900142:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900147:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900153:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900158:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900163:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784524.900626:0:5824:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff945903319c00:5824] 1 exiting: rc = 0 00000100:00100000:3.0:1790784524.900738:0:5823:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff9459057b0200:5823] 0 exiting: rc = 1 00000100:00100000:1.0:1790784524.900887:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900895:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900901:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900907:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900913:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900920:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900926:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900938:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900946:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900962:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900969:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900975:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900980:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900986:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900992:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.900997:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901003:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901009:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901015:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901020:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901026:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901043:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901050:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901055:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901061:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901067:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901073:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901078:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901084:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901090:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901096:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901102:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901107:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901126:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901134:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901148:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901155:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901161:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901168:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901174:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901180:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901187:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901193:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901202:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901215:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901236:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901243:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901248:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901254:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901260:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901266:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901271:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901277:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901282:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901288:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901294:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901299:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901318:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901324:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901330:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901335:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901340:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901345:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790784524.901351:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784524.911513:0:5825:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff945918640c00:5825] 0 exiting: rc = 1 00000100:00100000:1.0:1790784524.911514:0:5826:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff945903318a00:5826] 1 exiting: rc = 0 00000100:00100000:3.0:1790784524.911676:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911683:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911689:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911694:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911699:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911705:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911710:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911716:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911721:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911727:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911733:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911738:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911743:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911749:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911755:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911760:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911765:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911770:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911774:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911779:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911783:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911803:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911808:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911814:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911819:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911824:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911829:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911835:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911839:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911844:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911849:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911855:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911860:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911865:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911872:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911876:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911881:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911886:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911891:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911896:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911901:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911906:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911911:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911916:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911920:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911925:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911929:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911933:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911937:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911941:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911945:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911950:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911954:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911959:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911965:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911971:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911984:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911989:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911993:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.911999:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.912004:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.912011:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.912016:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.912021:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784524.913494:0:5828:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9459057e4800:5828] 1 exiting: rc = 0 00000100:00100000:1.0:1790784524.914291:0:5827:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff945918640e00:5827] 0 exiting: rc = 1 00000100:00100000:3.0:1790784524.914460:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914468:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914473:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914490:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914496:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914501:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914506:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914511:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914589:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914596:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914602:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914607:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914612:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914617:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914622:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914627:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914632:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914637:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914642:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914647:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914653:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914658:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914665:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914670:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914675:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914681:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914686:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914704:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914709:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914715:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914720:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914725:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914731:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914736:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914741:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914748:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914754:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914760:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914765:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914772:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914777:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914783:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914790:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914795:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914801:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914807:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914812:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914817:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914821:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914827:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914831:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914836:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914840:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914845:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914850:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914855:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914860:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914865:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914871:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914875:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914880:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914885:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914898:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.914903:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784524.915655:0:5829:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff9459067c4400:5829] 0 exiting: rc = 1 00000100:00100000:1.0:1790784524.920740:0:5830:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9459067c5e00:5830] 1 exiting: rc = 0 00000100:00100000:3.0:1790784524.920909:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.920916:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.920921:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.920926:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.920930:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.920935:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.920940:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.920944:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.920949:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.920954:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.920959:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.920963:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.920968:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.920973:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.920977:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.920982:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.920986:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.920991:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.920996:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921000:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921005:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921010:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921015:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921020:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921024:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921030:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921035:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921039:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921044:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921050:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921054:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921059:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921063:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921078:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921083:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921088:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921093:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921098:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921103:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921108:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921113:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921117:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921122:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921127:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921131:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921136:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921149:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921154:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921159:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921164:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921169:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921174:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921178:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921183:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921187:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921192:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921196:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921201:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921206:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921210:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921214:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921219:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921223:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921227:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.921809:0:5832:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff9459057de400:5832] 1 exiting: rc = 0 00000100:00100000:3.0:1790784524.921970:0:5833:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff94590579c200:5833] 2 exiting: rc = 0 00000100:00100000:0.0:1790784524.922183:0:5831:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff9459057e5a00:5831] 0 exiting: rc = 1 00000100:00100000:3.0:1790784524.922313:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922331:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922342:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922348:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922353:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922359:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922365:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922392:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922399:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922405:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922411:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922417:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922422:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922428:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922433:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922438:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922443:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922449:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922454:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922459:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922464:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922469:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922474:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922490:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922498:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922603:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922612:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922618:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922624:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922630:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922636:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922642:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922647:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922653:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922658:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922664:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922670:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922685:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922691:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922696:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922701:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922707:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922713:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922718:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922724:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922730:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922735:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922740:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922746:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922765:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922774:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922780:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922785:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922791:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922796:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922802:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922807:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922812:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922818:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922823:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922829:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922834:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922839:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790784524.922844:0:12937:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1790784524.927910:0:12937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790784524.927923:0:12937:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1790784524.927928:0:12937:0:(genops.c:885:class_export_put()) final put ffff9459103c5800/MDS_uuid 00000020:00000080:3.0:1790784524.927933:0:12937:0:(genops.c:844:class_export_destroy()) destroying export ffff9459103c5800/MDS_uuid for MDS 00000020:01000000:3.0:1790784524.927940:0:12937:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1790784524.928107:0:12937:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00000001:00100000:0.0:1790784525.821832:0:6693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790784525.821840:0:6693:0:(genops.c:885:class_export_put()) final put ffff94593fa99000/lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1790784525.821867:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790784525.821953:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94593fa99000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1790784525.822007:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94593fa9e800 for lustre-OST0000 00010000:00010000:0.0:1790784526.843455:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790784527.845205:0:13089:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1790784527.853654:0:13089:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1790784527.853698:0:13089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945907103000/0x2c3a1e2a079d3692 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d3699 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784527.853725:0:13089:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945907103000/0x2c3a1e2a079d3692 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d3699 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784527.853733:0:13089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945907103000/0x2c3a1e2a079d3692 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2c3a1e2a079d3699 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784527.853741:0:13089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.132@tcp lock: ffff945907103000/0x2c3a1e2a079d3692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2c3a1e2a079d3699 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784527.853766:0:13089:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790784527.853771:0:13089:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1790784527.853776:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790784527.853785:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff945907103000/0x2c3a1e2a079d3692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2c3a1e2a079d3699 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790784527.853794:0:13089:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:0.0:1790784527.853796:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945907103000 already unused, calling callback (ffffffffc1bf9c20) 00000100:00100000:2.0:1790784527.853801:0:13089:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 10000000:00010000:0.0:1790784527.853802:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff945907103000/0x2c3a1e2a079d3692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2c3a1e2a079d3699 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790784527.853810:0:13089:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00010000:0.0:1790784527.853814:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff945907103000/0x2c3a1e2a079d3692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x2c3a1e2a079d3699 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790784527.853817:0:13089:0:(import.c:65:import_set_state_nolock()) ffff94593f687000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1790784527.853825:0:13089:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:00010000:0.0:1790784527.853828:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff945907103000/0x2c3a1e2a079d3692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x2c3a1e2a079d3699 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784527.853829:0:13089:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790784527.853836:0:13089:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1790784527.853841:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790784527.853846:0:5806:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1790784527.853849:0:5806:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1790784527.853898:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff945907103000/0x2c3a1e2a079d3692 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x2c3a1e2a079d3699 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784527.853905:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790784527.853925:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff945907103000/0x2c3a1e2a079d3692 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x2c3a1e2a079d3699 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784527.853932:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff945907103000/0x2c3a1e2a079d3692 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x2c3a1e2a079d3699 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784527.853962:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784527.853964:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784527.853966:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784527.853984:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359598464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790784527.854042:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784527.854112:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359598464 00000100:00100000:0.0:1790784527.854119:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359598464 00000100:00100000:0.0:1790784527.854156:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790784527.854163:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3279:x1877773359598464:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1790784527.854168:0:8421:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790784527 with bad export cookie 3186892852183249787 00010000:00010000:2.0:1790784527.855363:0:13089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff94590955f200/0x2c3a1e2a079d36a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d36a7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784527.855412:0:13089:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff94590955f200/0x2c3a1e2a079d36a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d36a7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784527.855420:0:13089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff94590955f200/0x2c3a1e2a079d36a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2c3a1e2a079d36a7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784527.855492:0:13089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.132@tcp lock: ffff94590955f200/0x2c3a1e2a079d36a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2c3a1e2a079d36a7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784527.855561:0:13089:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790784527.855570:0:13089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d38c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d38d0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784527.855577:0:13089:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d38c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d38d0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784527.855583:0:13089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d38c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2c3a1e2a079d38d0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784527.855590:0:13089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d38c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2c3a1e2a079d38d0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784527.855603:0:13089:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1790784527.855607:0:13089:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1790784527.855625:0:13089:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1790784527.855628:0:13089:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1790784527.855632:0:13089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790784527.855637:0:13089:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790784527.855641:0:13089:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff94593c4a3380) has no exports 00000020:00080000:2.0:1790784527.855661:0:13089:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff94593c4a3380) has no exports 00010000:00010000:1.0:1790784527.855726:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790784527.855733:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff94590955f200/0x2c3a1e2a079d36a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2c3a1e2a079d36a7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784527.855748:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955f200 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:1.0:1790784527.855752:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff94590955f200/0x2c3a1e2a079d36a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2c3a1e2a079d36a7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784527.855760:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff94590955f200/0x2c3a1e2a079d36a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x2c3a1e2a079d36a7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790784527.855767:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff94590955f200/0x2c3a1e2a079d36a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x2c3a1e2a079d36a7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790784527.855773:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790784527.855776:0:5805:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1790784527.855778:0:5805:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1790784527.855805:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff94590955f200/0x2c3a1e2a079d36a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2c3a1e2a079d36a7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784527.855812:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790784527.855832:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff94590955f200/0x2c3a1e2a079d36a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2c3a1e2a079d36a7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784527.855839:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff94590955f200/0x2c3a1e2a079d36a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2c3a1e2a079d36a7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784527.855852:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790784527.855856:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d38c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2c3a1e2a079d38d0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784527.855872:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900031600 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:1.0:1790784527.855875:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d38c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2c3a1e2a079d38d0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784527.855888:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d38c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2c3a1e2a079d38d0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790784527.855894:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d38c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2c3a1e2a079d38d0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790784527.855900:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1790784527.855902:0:5805:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1790784527.855904:0:5805:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1790784527.855919:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d38c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2c3a1e2a079d38d0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784527.855925:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790784527.855942:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d38c9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2c3a1e2a079d38d0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784527.855949:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d38c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2c3a1e2a079d38d0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784527.855960:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784527.855962:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784527.855963:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790784527.855976:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359598720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790784527.856168:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784527.857068:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359598720 00000100:00100000:1.0:1790784527.857079:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359598720 00000100:00100000:1.0:1790784527.857120:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790784527.857127:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945905107050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3281:x1877773359598720:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1790784527.857135:0:5804:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790784527 with bad export cookie 3186892852183249787 00000100:00100000:1.0:1790784527.857205:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945905107050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3281:x1877773359598720:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (1037us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790784527.857212:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1790784527.857270:0:3281:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.132@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790784527.857275:0:3281:0:(import.c:65:import_set_state_nolock()) ffff945905fd7000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1790784527.857279:0:3281:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.132@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:01000000:2.0:1790784527.859091:0:13089:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94591033aa80 - data ffff94580159f6c0/ffff945907d31400 00000020:01000000:2.0:1790784527.859241:0:13089:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff945907dce3c0 - data ffff94590f971798/ffff94593f8ef400 00010000:00010000:3.0:1790784527.870210:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784527.891826:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3279:x1877773359598464:12345-0@lo:103:ldlm_bl.0 Request processed in 37649us (37770us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790784527.891844:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1790784527.891951:0:3279:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.132@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790784527.914051:0:3281:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.132@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1790784527.914057:0:3281:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1790784527.914065:0:3281:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94590569fb80 x1877773359598464/t0(0) o103->MGC192.168.206.132@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790784543 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790784527.914081:0:3281:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94592daa2a00 x1877773359598720/t0(0) o103->MGC192.168.206.132@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790784543 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1790784527.914100:0:3281:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1790784527.914103:0:3281:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1790784527.914104:0:3281:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1790784527.914108:0:3281:0:(import.c:65:import_set_state_nolock()) ffff945905fd7000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790784527.914113:0:3281:0:(import.c:545:import_select_connection()) MGC192.168.206.132@tcp: connect to NID 0@lo last attempt 126 00000100:00080000:1.0:1790784527.914126:0:3281:0:(import.c:666:import_select_connection()) MGC192.168.206.132@tcp: import ffff945905fd7000 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:0.0:1790784527.914142:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:0:1877773359598592:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1790784527.914164:0:3279:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff945905fd7000 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:1.0:1790784527.914273:0:3281:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94592daa0700 x1877773359598848/t0(0) o250->MGC192.168.206.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790784527.914317:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3281:1877773359598720:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790784527.914331:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784527.914566:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3279:1877773359598464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790784527.914585:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3278:1877773359598848:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1790784527.914636:0:3278:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877773359598848 offset 0 length 520: 4 00100000:10000000:3.0:1790784527.920964:0:13089:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1790784527.941667:0:13089:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d34af 00000020:00000080:3.0:1790784527.941680:0:13089:0:(genops.c:885:class_export_put()) final put ffff94593f683800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1790784527.941690:0:13089:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9459050db000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1790784527.941693:0:13089:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9459050db000 2 00000020:01000004:3.0:1790784527.941696:0:13089:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9459050db000 from lustre-OST0000 00000020:00000080:3.0:1790784527.941716:0:13089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790784527.941725:0:13089:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1790784527.941727:0:13089:0:(genops.c:885:class_export_put()) final put ffff945935d86800/lustre-OST0000_UUID 00000020:00000080:3.0:1790784527.941729:0:13089:0:(genops.c:844:class_export_destroy()) destroying export ffff945935d86800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1790784527.941735:0:13089:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1790784527.941766:0:13089:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1790784527.941769:0:13089:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1790784527.941772:0:13089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790784527.941776:0:13089:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790784527.941781:0:13089:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff94593f923800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790784527.941786:0:13089:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff94593c4a0000) has exports, disconnecting them 00000020:00080000:3.0:1790784527.941791:0:13089:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff94593f923800), last request at 1790784311 00000020:00000080:3.0:1790784527.941794:0:13089:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d34d9 00000020:00080000:3.0:1790784527.941801:0:13089:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff94593f923800): rc 0 00000020:00000080:3.0:1790784527.941815:0:13089:0:(genops.c:885:class_export_put()) final put ffff94593f923800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1790784527.941921:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94593f683800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1790784527.941937:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94593f923800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1790784527.944426:0:13089:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1790784527.944440:0:13089:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790784527.944444:0:13089:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790784527.944450:0:13089:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790784527.944519:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff94593f687000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1790784527.944675:0:13089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790784527.944686:0:13089:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1790784527.944691:0:13089:0:(genops.c:885:class_export_put()) final put ffff94593f680800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1790784527.944697:0:13089:0:(genops.c:844:class_export_destroy()) destroying export ffff94593f680800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1790784527.944705:0:13089:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1790784527.944757:0:13089:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9459050db000 1 00000020:00000080:2.0:1790784527.944762:0:13089:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d3469 00000020:00000080:2.0:1790784527.944771:0:13089:0:(genops.c:885:class_export_put()) final put ffff94593bede000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1790784527.944784:0:13089:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1790784527.944788:0:13089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790784527.944791:0:13089:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790784527.944795:0:13089:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff945935d719c0) has no exports 00000020:00000080:1.0:1790784527.944824:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94593bede000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1790784527.962596:0:13089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790784527.962615:0:13089:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1790784527.962621:0:13089:0:(genops.c:885:class_export_put()) final put ffff9459050de800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1790784527.962626:0:13089:0:(genops.c:844:class_export_destroy()) destroying export ffff9459050de800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1790784527.962633:0:13089:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1790784527.962752:0:13089:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9459050d9000 00000020:02000400:2.0:1790784527.962803:0:13089:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:1.0:1790784528.826629:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790784528.826646:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790784528.826650:0:8:0:(import.c:65:import_set_state_nolock()) ffff945935df6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790784528.826665:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 357 00000100:00080000:1.0:1790784528.826677:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790784528.826688:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff945935df6800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:1.0:1790784528.826730:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94592daa2a00 x1877773359598976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790784528.826887:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3278:1877773359598976:0@lo:38:kworker.0 00000400:00000100:3.0:1790784528.826932:0:3278:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877773359598976 offset 0 length 520: 4 00010000:00010000:1.0:1790784528.892629:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784529.914493:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790784530.729563:0:13239:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1790784530.766151:0:13239:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1790784530.766223:0:13239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff94590955e400/0x2c3a1e2a079d3676 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d367d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784530.766239:0:13239:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff94590955e400/0x2c3a1e2a079d3676 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d367d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784530.766247:0:13239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff94590955e400/0x2c3a1e2a079d3676 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2c3a1e2a079d367d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784530.766253:0:13239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.132@tcp lock: ffff94590955e400/0x2c3a1e2a079d3676 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2c3a1e2a079d367d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784530.766266:0:13239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790784530.766271:0:13239:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1790784530.766302:0:13239:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790784530.766314:0:13239:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94592daa2a00 x1877773359598976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790784543 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784530.766337:0:13239:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790784530.766343:0:13239:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790784530.766348:0:13239:0:(import.c:65:import_set_state_nolock()) ffff945935df6800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1790784530.766352:0:13239:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790784530.766356:0:13239:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94592daa2a00 x1877773359598976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790784543 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784530.766364:0:13239:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790784530.766404:0:13239:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00010000:00010000:1.0:1790784530.767177:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790784530.767185:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff94590955e400/0x2c3a1e2a079d3676 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2c3a1e2a079d367d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784530.767194:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955e400 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:1.0:1790784530.767198:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff94590955e400/0x2c3a1e2a079d3676 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2c3a1e2a079d367d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784530.767206:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff94590955e400/0x2c3a1e2a079d3676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2c3a1e2a079d367d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790784530.767212:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff94590955e400/0x2c3a1e2a079d3676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2c3a1e2a079d367d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790784530.767217:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790784530.767220:0:5806:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1790784530.767222:0:5806:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1790784530.767236:0:5806:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff945905fd7000 00010000:00010000:1.0:1790784530.767239:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff94590955e400/0x2c3a1e2a079d3676 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2c3a1e2a079d367d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784530.767246:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff94590955e400/0x2c3a1e2a079d3676 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2c3a1e2a079d367d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784530.767259:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784530.767270:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784530.767272:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784530.767547:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3278:1877773359598976:0@lo:38:kworker.0 00010000:00010000:3.0:1790784530.769423:0:13239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945909575000/0x2c3a1e2a079d3684 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d368b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784530.769443:0:13239:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945909575000/0x2c3a1e2a079d3684 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d368b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784530.769462:0:13239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945909575000/0x2c3a1e2a079d3684 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2c3a1e2a079d368b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784530.769469:0:13239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.132@tcp lock: ffff945909575000/0x2c3a1e2a079d3684 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2c3a1e2a079d368b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784530.769500:0:13239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790784530.769507:0:13239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945907103800/0x2c3a1e2a079d38bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d38c2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784530.769514:0:13239:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945907103800/0x2c3a1e2a079d38bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d38c2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784530.769521:0:13239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945907103800/0x2c3a1e2a079d38bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2c3a1e2a079d38c2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784530.769527:0:13239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.132@tcp lock: ffff945907103800/0x2c3a1e2a079d38bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2c3a1e2a079d38c2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784530.769540:0:13239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1790784530.769545:0:13239:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1790784530.769566:0:13239:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1790784530.769570:0:13239:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1790784530.769574:0:13239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1790784530.769996:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790784530.770003:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff945909575000/0x2c3a1e2a079d3684 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2c3a1e2a079d368b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784530.770011:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945909575000 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:1.0:1790784530.770015:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff945909575000/0x2c3a1e2a079d3684 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2c3a1e2a079d368b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784530.770024:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff945909575000/0x2c3a1e2a079d3684 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2c3a1e2a079d368b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790784530.770031:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff945909575000/0x2c3a1e2a079d3684 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2c3a1e2a079d368b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790784530.770037:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790784530.770039:0:5806:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1790784530.770042:0:5806:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1790784530.770057:0:5806:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff945905fd7000 00010000:00010000:1.0:1790784530.770061:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff945909575000/0x2c3a1e2a079d3684 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2c3a1e2a079d368b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784530.770069:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff945909575000/0x2c3a1e2a079d3684 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2c3a1e2a079d368b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784530.770087:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790784530.770090:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff945907103800/0x2c3a1e2a079d38bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2c3a1e2a079d38c2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784530.770095:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945907103800 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:1.0:1790784530.770106:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff945907103800/0x2c3a1e2a079d38bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2c3a1e2a079d38c2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784530.770112:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff945907103800/0x2c3a1e2a079d38bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2c3a1e2a079d38c2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790784530.770118:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff945907103800/0x2c3a1e2a079d38bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2c3a1e2a079d38c2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790784530.770124:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1790784530.770126:0:5806:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1790784530.770128:0:5806:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1790784530.770133:0:5806:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff945905fd7000 00010000:00010000:1.0:1790784530.770137:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff945907103800/0x2c3a1e2a079d38bb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2c3a1e2a079d38c2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784530.770143:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff945907103800/0x2c3a1e2a079d38bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2c3a1e2a079d38c2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784530.770156:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784530.770158:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784530.770160:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784530.770246:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790784530.772259:0:13239:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790784530.772269:0:13239:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff94592d5dcd40) has no exports 00000020:00080000:3.0:1790784530.772364:0:13239:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff94592d5dcd40) has no exports 00000020:01000000:3.0:1790784530.782148:0:13239:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94591014f0c0 - data ffff94593fca3288/ffff94592d50e400 00000020:01000000:3.0:1790784530.782320:0:13239:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff945910275300 - data ffff9459297ba6c0/ffff94592d50d400 00100000:10000000:2.0:1790784530.808419:0:13239:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1790784530.880141:0:13239:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d357a 00000020:00000080:0.0:1790784530.880151:0:13239:0:(genops.c:885:class_export_put()) final put ffff94592d5d7000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1790784530.880169:0:13239:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94593fa9a800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1790784530.880174:0:13239:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94593fa9a800 2 00000020:01000004:0.0:1790784530.880178:0:13239:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff94593fa9a800 from lustre-OST0001 00000020:00000080:0.0:1790784530.880208:0:13239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790784530.880218:0:13239:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1790784530.880221:0:13239:0:(genops.c:885:class_export_put()) final put ffff94592d5d2800/lustre-OST0001_UUID 00000020:00000080:0.0:1790784530.880224:0:13239:0:(genops.c:844:class_export_destroy()) destroying export ffff94592d5d2800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1790784530.880242:0:13239:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1790784530.880347:0:13239:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import d3e7b7e5-0721-4246-a3a0-5d40e18144b6->MGS 00010000:00010000:0.0:1790784530.880363:0:13239:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff945901524400/0x2c3a1e2a079d348c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2c3a1e2a079d3493 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790784530.880401:0:13239:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff945901524400/0x2c3a1e2a079d348c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2c3a1e2a079d3493 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790784530.880409:0:13239:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1790784530.880412:0:13239:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1790784530.880415:0:13239:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1790784530.880428:0:13239:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff945905fd7000 00010000:00010000:0.0:1790784530.880432:0:13239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff945901524400/0x2c3a1e2a079d348c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2c3a1e2a079d3493 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784530.880458:0:13239:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff945909574e00/0x2c3a1e2a079d36d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2c3a1e2a079d36d8 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790784530.880466:0:13239:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff945909574e00/0x2c3a1e2a079d36d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2c3a1e2a079d36d8 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790784530.880471:0:13239:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790784530.880474:0:13239:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1790784530.880475:0:13239:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1790784530.880484:0:13239:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff945905fd7000 00010000:00010000:0.0:1790784530.880487:0:13239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff945909574e00/0x2c3a1e2a079d36d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2c3a1e2a079d36d8 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790784530.880502:0:13239:0:(import.c:65:import_set_state_nolock()) ffff945905fd7000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1790784530.880506:0:13239:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1790784530.880508:0:13239:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1790784530.880527:0:13239:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1790784530.880532:0:13239:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1790784530.880543:0:13239:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94592daa0700 x1877773359598848/t0(0) o250->MGC192.168.206.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1790784537 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1790784530.880558:0:13239:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1790784530.880561:0:13239:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000020:00000080:1.0:1790784530.880795:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94592d5d7000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:2.0:1790784530.880945:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d3e7b7e5-0721-4246-a3a0-5d40e18144b6:3278:1877773359598848:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:1.0:1790784530.881003:0:13239:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1790784530.881010:0:13239:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d336d 00000020:00000080:1.0:1790784530.881015:0:13239:0:(genops.c:885:class_export_put()) final put ffff9459103c2800/d3e7b7e5-0721-4246-a3a0-5d40e18144b6 00000020:01000000:1.0:1790784530.881030:0:13239:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.132@tcp (flags='') 00000020:00000080:1.0:1790784530.881035:0:13239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790784530.881039:0:13239:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.132@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1790784530.881042:0:13239:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9459057499c0) has no exports 10000000:01000000:1.0:1790784530.881059:0:5815:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1790784530.881109:0:13239:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.132@tcp: client import never connected 00000100:00080000:1.0:1790784530.881112:0:13239:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1790784530.881114:0:13239:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1790784530.881116:0:13239:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1790784530.881117:0:13239:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1790784530.881146:0:13239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790784530.881151:0:13239:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.132@tcp (uuid d3e7b7e5-0721-4246-a3a0-5d40e18144b6) 00000020:01000000:1.0:1790784530.881156:0:13239:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1790784530.881158:0:13239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790784530.881162:0:13239:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790784530.881178:0:13239:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff945935df5000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790784530.881183:0:13239:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff945905748000) has exports, disconnecting them 00000020:00080000:1.0:1790784530.881187:0:13239:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff945935df5000), last request at 1790784329 00000020:00000080:1.0:1790784530.881191:0:13239:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d35a4 00000020:00080000:1.0:1790784530.881201:0:13239:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff945935df5000): rc 0 00000020:00000080:1.0:1790784530.881204:0:13239:0:(genops.c:885:class_export_put()) final put ffff945935df5000/lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1790784530.882204:0:13239:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1790784530.882209:0:13239:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790784530.882212:0:13239:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790784530.882218:0:13239:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790784530.883417:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9459103c2800/d3e7b7e5-0721-4246-a3a0-5d40e18144b6 for MGC192.168.206.132@tcp 00000020:00000080:2.0:1790784530.883436:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff945905fd7000 for MGC192.168.206.132@tcp 00000020:00000080:2.0:1790784530.883444:0:8:0:(genops.c:885:class_export_put()) final put ffff9459103c5000/d3e7b7e5-0721-4246-a3a0-5d40e18144b6 00000020:00000080:2.0:1790784530.883456:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9459103c5000/d3e7b7e5-0721-4246-a3a0-5d40e18144b6 for MGC192.168.206.132@tcp 00000020:01000000:2.0:1790784530.883461:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.132@tcp (d3e7b7e5-0721-4246-a3a0-5d40e18144b6) 00000020:00000080:1.0:1790784530.884059:0:13239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790784530.884070:0:13239:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1790784530.884076:0:13239:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94593fa9a800 1 00000020:00000080:1.0:1790784530.884083:0:13239:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x2c3a1e2a079d3549 00000020:00000080:1.0:1790784530.884090:0:13239:0:(genops.c:885:class_export_put()) final put ffff94593f685800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1790784530.884110:0:13239:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1790784530.884116:0:13239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790784530.884121:0:13239:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790784530.884125:0:13239:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff94592d4cb380) has no exports 00010000:00010000:0.0:1790784530.884235:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1790784530.884351:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:0.0:1790784530.884457:0:5801:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff945904d56c00:5801] 1 exiting: rc = 0 00000100:00100000:0.0:1790784530.884865:0:5800:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff945903495c00:5800] 0 exiting: rc = 1 00000100:00100000:0.0:1790784530.884923:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.885125:0:8480:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_004: service thread [ffff94593f66d800:8480] 4 exiting: rc = 0 00000100:00100000:0.0:1790784530.885186:0:5802:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9459183ed600:5802] 0 exiting: rc = 1 00000100:00100000:0.0:1790784530.885245:0:5803:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff945906bffa00:5803] 1 exiting: rc = 0 00000100:00100000:0.0:1790784530.885912:0:8421:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff94592d1e4600:8421] 3 exiting: rc = 0 00000020:00000080:0.0:1790784530.922089:0:13239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790784530.922104:0:13239:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000100:00100000:0.0:1790784530.961041:0:5804:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff945906bfe400:5804] 2 exiting: rc = 0 00000100:00100000:2.0:1790784530.961126:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961134:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961140:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961145:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961151:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961155:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961161:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961168:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961173:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961178:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961183:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961188:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961194:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961199:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961205:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961210:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961216:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961222:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961227:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961231:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961236:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961241:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961247:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961252:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961256:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961261:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961265:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961269:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961274:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961278:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961283:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961288:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961293:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961297:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961302:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961322:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961327:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961331:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961336:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961341:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961345:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961350:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961355:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961359:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961363:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961368:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961389:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961396:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961402:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961407:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961412:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961417:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961421:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961426:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961431:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961436:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961440:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961444:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961462:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961467:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961472:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961476:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961480:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790784530.961486:0:8:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1790784530.962246:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff945935df5000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1790784530.962261:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff945935df6800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1790784530.962267:0:8:0:(genops.c:885:class_export_put()) final put ffff945935df7000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1790784530.962271:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff945935df7000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1790784530.962275:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1790784530.962317:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94593f685800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1790784530.962322:0:8:0:(genops.c:885:class_export_put()) final put ffff94593fa9d800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1790784530.962324:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff94593fa9d800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1790784530.962328:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1790784530.962565:0:13239:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff94593fa9f000 00000020:01000000:0.0:1790784530.962589:0:13239:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1790784530.962596:0:13239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790784530.962601:0:13239:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790784530.962606:0:13239:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff94592d4c99c0) has no exports 00000020:00000080:0.0:1790784530.962630:0:13239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790784530.962636:0:13239:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1790784530.962639:0:13239:0:(genops.c:885:class_export_put()) final put ffff94593bedf800/OSS_uuid 00000020:00000080:0.0:1790784530.962641:0:13239:0:(genops.c:844:class_export_destroy()) destroying export ffff94593bedf800/OSS_uuid for OSS 00000020:01000000:0.0:1790784530.962644:0:13239:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1790784530.962715:0:6669:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff94590566b000:6669] 1 exiting: rc = 0 00000100:00080000:2.0:1790784530.962789:0:5814:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1790784530.962883:0:6668:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff94591054de00:6668] 0 exiting: rc = 1 00000100:00100000:1.0:1790784530.963038:0:8181:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff945934b3f200:8181] 3 exiting: rc = 0 00000100:00100000:3.0:1790784530.968948:0:6670:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff94591054d200:6670] 2 exiting: rc = 0 00000100:00100000:0.0:1790784530.969182:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969191:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969197:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969215:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969220:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969226:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969231:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969237:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969242:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969247:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969253:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969258:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969263:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969268:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969274:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969278:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969283:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969287:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969292:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969297:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969302:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969306:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969312:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969317:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969321:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969326:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969331:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969336:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969341:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969347:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969353:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969358:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969362:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969367:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969388:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969394:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969399:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969404:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969417:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969421:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969426:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969431:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969435:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969440:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969459:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969466:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969471:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969478:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969482:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969487:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969492:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969497:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969503:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969507:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969513:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969518:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969523:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969528:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969533:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969540:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969545:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969550:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969556:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.969562:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.970248:0:6672:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff94591054da00:6672] 1 exiting: rc = 0 00000100:00100000:2.0:1790784530.971671:0:6671:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff94590507d600:6671] 0 exiting: rc = 1 00000100:00100000:0.0:1790784530.974009:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974024:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974030:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974036:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974042:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974047:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974053:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974070:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974092:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974096:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974100:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974105:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974109:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974114:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974118:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974123:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974127:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974132:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974137:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974142:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974147:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974152:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974156:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974161:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974165:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974170:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974174:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974179:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974183:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974188:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974193:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974197:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974202:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974206:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974211:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974215:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974220:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974224:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974229:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974234:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974238:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974243:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974247:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974259:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974264:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974269:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974273:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974278:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974282:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974287:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974292:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974297:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974303:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974309:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974314:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974319:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974324:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974329:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974334:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974339:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974344:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974349:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974354:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.974360:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.975327:0:6673:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff94590507d400:6673] 0 exiting: rc = 1 00000100:00100000:2.0:1790784530.975644:0:6675:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9459051fac00:6675] 2 exiting: rc = 0 00000100:00100000:2.0:1790784530.975805:0:6674:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff94590507c400:6674] 1 exiting: rc = 0 00000100:00100000:0.0:1790784530.979216:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979227:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979233:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979239:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979244:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979249:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979255:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979260:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979265:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979287:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979294:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979301:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979307:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979326:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979332:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979337:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979343:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979349:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979354:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979359:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979365:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979371:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979399:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979405:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979411:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979417:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979422:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979428:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979434:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979440:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979456:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979463:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979468:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979489:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979495:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979500:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979505:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979512:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979762:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979772:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979778:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979784:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979790:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979795:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979802:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979808:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.979813:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.980263:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.980280:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.980285:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.980291:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.980296:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.980307:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.980319:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.980328:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.980346:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.980352:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.980358:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.980363:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.980369:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.980458:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.980466:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.980471:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.980486:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.997603:0:6677:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9459051fb200:6677] 1 exiting: rc = 0 00000100:00100000:2.0:1790784530.997774:0:6676:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff945905f68000:6676] 0 exiting: rc = 1 00000100:00100000:0.0:1790784530.998767:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998775:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998781:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998786:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998792:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998797:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998802:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998807:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998811:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998817:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998822:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998826:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998831:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998836:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998840:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998844:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998849:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998853:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998874:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998878:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998884:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998889:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998893:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998898:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998903:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998908:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998912:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998917:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998922:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998928:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998933:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998937:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998943:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998949:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998954:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998959:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998964:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998969:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998974:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998979:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998984:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998989:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998994:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.998999:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.999005:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.999010:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.999014:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.999018:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.999023:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.999027:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.999032:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.999037:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.999042:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.999056:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.999061:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.999066:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.999070:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.999075:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.999081:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.999085:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.999090:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.999096:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.999100:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784530.999105:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.008773:0:6679:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff94592d01ea00:6679] 1 exiting: rc = 0 00000100:00100000:2.0:1790784531.009019:0:6678:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff945907c6da00:6678] 0 exiting: rc = 1 00000100:00100000:0.0:1790784531.009130:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009139:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009147:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009157:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009165:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009171:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009179:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009190:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009197:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009203:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009209:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009235:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009243:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009252:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009259:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009264:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009270:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009280:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009287:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009294:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009301:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009307:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009313:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009358:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009368:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009400:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009408:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009414:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009420:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009426:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009431:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009438:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009445:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009462:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009469:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009509:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.009518:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.012730:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.012744:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.012751:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.012759:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.012764:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.012771:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.012779:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.012786:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.012793:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.012799:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.012845:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.012852:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.012858:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.012863:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.012869:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.012875:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.012880:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.012890:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.012898:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.012904:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.012909:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.012933:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.012953:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.012960:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.012966:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.012972:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790784531.012978:0:13239:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1790784531.041565:0:13239:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1790784552.345103:0:13857:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg632-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1790784562.173328:0:14317:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790784562.173340:0:14317:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1790784562.173520:0:14317:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff94593c4ab000 00000020:01000004:1.0:1790784562.173533:0:14317:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1790784562.173540:0:14317:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1790784562.173551:0:14317:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff94592d5d99c0) 00000020:00000080:1.0:1790784562.173561:0:14317:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1790784562.204206:0:14317:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1790784562.210641:0:14317:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1790784562.211252:0:14317:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1790784562.211330:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 427: rc = 0 00100000:10000000:1.0:1790784562.212528:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 427: rc = 0 00100000:10000000:1.0:1790784562.212661:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 427: rc = 0 00100000:10000000:1.0:1790784562.213014:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 427: rc = 0 00100000:10000000:1.0:1790784562.213111:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 427: rc = 0 00100000:10000000:1.0:1790784562.213206:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 427: rc = 0 00100000:10000000:1.0:1790784562.214072:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 513: rc = 0 00100000:10000000:1.0:1790784562.216222:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 307: rc = 0 00100000:10000000:1.0:1790784562.216360:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 307: rc = 0 00100000:10000000:1.0:1790784562.217188:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 649: rc = 0 00100000:10000000:1.0:1790784562.217499:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 649: rc = 0 00100000:10000000:1.0:1790784562.218038:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 649: rc = 0 00100000:10000000:1.0:1790784562.218869:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 649: rc = 0 00100000:10000000:1.0:1790784562.219123:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 649: rc = 0 00100000:10000000:1.0:1790784562.220923:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 649: rc = 0 00100000:10000000:1.0:1790784562.221194:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 649: rc = 0 00100000:10000000:1.0:1790784562.224328:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 649: rc = 0 00100000:10000000:2.0:1790784562.225594:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 649: rc = 0 00100000:10000000:2.0:1790784562.230141:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 649: rc = 0 00100000:10000000:2.0:1790784562.232018:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 649: rc = 0 00100000:10000000:2.0:1790784562.232347:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 649: rc = 0 00100000:10000000:2.0:1790784562.240094:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 444: rc = 0 00100000:10000000:2.0:1790784562.241326:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 444: rc = 0 00100000:10000000:2.0:1790784562.241714:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 444: rc = 0 00100000:10000000:2.0:1790784562.241993:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 444: rc = 0 00100000:10000000:2.0:1790784562.242260:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 444: rc = 0 00100000:10000000:2.0:1790784562.242603:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 444: rc = 0 00100000:10000000:2.0:1790784562.242857:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 444: rc = 0 00100000:10000000:2.0:1790784562.243101:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 444: rc = 0 00100000:10000000:2.0:1790784562.243366:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 444: rc = 0 00100000:10000000:2.0:1790784562.243655:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 444: rc = 0 00100000:10000000:2.0:1790784562.245035:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 444: rc = 0 00100000:10000000:2.0:1790784562.245332:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 444: rc = 0 00100000:10000000:2.0:1790784562.245980:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 444: rc = 0 00100000:10000000:2.0:1790784562.246246:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 444: rc = 0 00100000:10000000:2.0:1790784562.247056:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 444: rc = 0 00100000:10000000:2.0:1790784562.247336:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 444: rc = 0 00100000:10000000:2.0:1790784562.247925:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 444: rc = 0 00100000:10000000:2.0:1790784562.248167:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 444: rc = 0 00100000:10000000:2.0:1790784562.250188:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 444: rc = 0 00100000:10000000:2.0:1790784562.257594:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 444: rc = 0 00100000:10000000:2.0:1790784562.258157:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 444: rc = 0 00100000:10000000:2.0:1790784562.259488:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 444: rc = 0 00100000:10000000:2.0:1790784562.259883:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 444: rc = 0 00100000:10000000:2.0:1790784562.260128:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 444: rc = 0 00100000:10000000:2.0:1790784562.260416:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 444: rc = 0 00100000:10000000:2.0:1790784562.262188:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 444: rc = 0 00100000:10000000:2.0:1790784562.262545:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 444: rc = 0 00100000:10000000:2.0:1790784562.266414:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 444: rc = 0 00100000:10000000:2.0:1790784562.266727:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 444: rc = 0 00100000:10000000:2.0:1790784562.267184:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 444: rc = 0 00100000:10000000:2.0:1790784562.267618:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 444: rc = 0 00100000:10000000:2.0:1790784562.268223:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 444: rc = 0 00100000:10000000:2.0:1790784562.272873:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 434: rc = 0 00100000:10000000:2.0:1790784562.281097:0:14317:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1790784562.281341:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 308: rc = 0 00100000:10000000:2.0:1790784562.281617:0:14317:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1790784562.281689:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 308: rc = 0 00100000:10000000:2.0:1790784562.281881:0:14317:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1790784562.281949:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 308: rc = 0 00100000:10000000:2.0:1790784562.282269:0:14317:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1790784562.282352:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 310: rc = 0 00100000:10000000:2.0:1790784562.282569:0:14317:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1790784562.282641:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 310: rc = 0 00100000:10000000:2.0:1790784562.282828:0:14317:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1790784562.282889:0:14317:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 310: rc = 0 00000020:00000080:2.0:1790784562.283149:0:14317:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1790784562.283156:0:14317:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790784562.283166:0:14317:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2c3a1e2a079d4660 00000020:01000004:2.0:1790784562.283174:0:14317:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1790784562.283178:0:14317:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1790784562.283183:0:14317:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94593c4ab000 from MGS 00000020:01000004:2.0:1790784562.283187:0:14317:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1790784562.283196:0:14317:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff94593c4a0000) 00000020:00000080:2.0:1790784562.283204:0:14317:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1790784562.283249:0:14317:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94593c4ab000 from MGS, refs=2 00080000:01000000:2.0:1790784562.283253:0:14317:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790784562.283257:0:14317:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2c3a1e2a079d466e 00000100:00100000:2.0:1790784562.283357:0:14317:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1790784562.283514:0:14317:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1790784562.283521:0:14317:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1790784562.295088:0:14317:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1790784562.301479:0:14317:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1790784562.304114:0:14317:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790784562.304306:0:14317:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1790784562.304313:0:14317:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1790784562.305213:0:14317:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1790784562.305221:0:14317:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1790784562.305736:0:14317:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1790784562.305742:0:14317:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1790784562.316084:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784562.316088:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784562.316089:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784562.316457:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784562.316459:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784562.316461:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784562.317253:0:14317:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1790784562.321008:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1790784562.354251:0:14317:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1790784562.354268:0:14317:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1790784562.354270:0:14317:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1790784562.372776:0:14326:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1790784562.373002:0:14317:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1790784562.373122:0:14317:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790784562.374187:0:14317:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1790784562.375830:0:14317:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790784562.375987:0:14317:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1790784562.375992:0:14317:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1790784562.379502:0:14317:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1790784562.379526:0:14317:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1790784562.382357:0:14317:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1790784562.382370:0:14317:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1790784562.383967:0:14317:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1790784562.383989:0:14317:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.132@tcp' 00000020:01000004:0.0:1790784562.383991:0:14317:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1790784562.384018:0:14317:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.132@tcp (typ=mgc) 00000020:00000080:0.0:1790784562.384031:0:14317:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.132@tcp (ffff94590574cd40) 00000020:00000080:0.0:1790784562.384044:0:14317:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1790784562.384113:0:14317:0:(ldlm_lib.c:102:import_set_conn()) imp ffff945910916800@MGC192.168.206.132@tcp: add connection 192.168.206.132@tcp at head 00010000:00010000:0.0:1790784562.384256:0:14317:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.132@tcp-0 is initialized 00000040:01000000:0.0:1790784562.384262:0:14317:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.132@tcp ctxt 1 is initialized 10000000:01000000:1.0:1790784562.390456:0:14333:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1790784562.390568:0:14317:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.132@tcp (uuid 43ffae34-ce63-4427-b2f1-54f812a9cb4d) 00000020:00000080:2.0:1790784562.390591:0:14317:0:(genops.c:1384:class_connect()) connect: client 43ffae34-ce63-4427-b2f1-54f812a9cb4d, cookie 0x2c3a1e2a079d467c 00000100:00080000:2.0:1790784562.390602:0:14317:0:(import.c:545:import_select_connection()) MGC192.168.206.132@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790784562.390612:0:14317:0:(import.c:666:import_select_connection()) MGC192.168.206.132@tcp: import ffff945910916800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:2.0:1790784562.390648:0:14317:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94592d9cc700 x1877773359599104/t0(0) o250->MGC192.168.206.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790784562.390683:0:14317:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 43ffae34-ce63-4427-b2f1-54f812a9cb4d->MGS 00000020:01000004:2.0:1790784562.390711:0:14317:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1790784562.390717:0:14317:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1790784562.390730:0:14317:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff94593c4a3380) 00000020:00000080:2.0:1790784562.390742:0:14317:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1790784562.394476:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3278:1877773359599104:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1790784562.394570:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784562.394645:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359599104 00000100:00100000:1.0:1790784562.394653:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359599104 00000100:00100000:1.0:1790784562.394691:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790784562.394698:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459366fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3278:x1877773359599104:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1790784562.394722:0:14328:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 43ffae34-ce63-4427-b2f1-54f812a9cb4d@0@lo t0 exp 0000000000000000 cur 396 last 0 00000020:00000080:1.0:1790784562.394748:0:14328:0:(genops.c:1384:class_connect()) connect: client 43ffae34-ce63-4427-b2f1-54f812a9cb4d, cookie 0x2c3a1e2a079d468a 00000100:00080000:1.0:1790784562.394876:0:14328:0:(import.c:65:import_set_state_nolock()) ffff945907c67000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790784562.394941:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459366fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+5:3278:x1877773359599104:12345-0@lo:250:mount.lustre.0 Request processed in 242us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784562.394948:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790784562.394982:0:3278:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.132@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1790784562.394989:0:3278:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.206.132@tcp: connect to target with instance 0 00000100:00080000:1.0:1790784562.394996:0:3278:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.206.132@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1790784562.395000:0:3278:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1790784562.395003:0:3278:0:(import.c:65:import_set_state_nolock()) ffff945910916800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1790784562.395006:0:3278:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1790784562.395013:0:3278:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1790784562.395018:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3278:1877773359599104:0@lo:250:mount.lustre.0 00000100:00080000:3.0:1790784562.398066:0:14331:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:2.0:1790784562.419315:0:14317:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790784562.419763:0:14317:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1790784562.419770:0:14317:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1790784562.423989:0:14317:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1790784562.424004:0:14317:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1790784562.425905:0:14317:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1790784562.425918:0:14317:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1790784562.427064:0:14317:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790784562.427225:0:14317:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1790784562.427229:0:14317:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1790784562.428455:0:14317:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1790784562.428466:0:14317:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1790784562.500629:0:14317:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790784562.500983:0:14317:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1790784562.500990:0:14317:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1790784562.517144:0:14317:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1790784562.517159:0:14317:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1790784562.518874:0:14317:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790784562.519047:0:14317:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790784562.519053:0:14317:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1790784562.522812:0:14317:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790784562.522824:0:14317:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1790784562.526216:0:14317:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790784562.526466:0:14317:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790784562.526472:0:14317:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1790784562.527465:0:14317:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790784562.527475:0:14317:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1790784562.528156:0:14317:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790784562.530648:0:14317:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790784562.530658:0:14317:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1790784562.531256:0:14317:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790784562.531268:0:14317:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1790784562.556842:0:14317:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790784562.557035:0:14317:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790784562.557042:0:14317:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1790784562.559339:0:14317:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790784562.559352:0:14317:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1790784562.560952:0:14317:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790784562.560965:0:14317:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1790784562.562370:0:14317:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1790784562.562416:0:14317:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1790784562.562422:0:14317:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.132@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1790784562.562612:0:14317:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.132@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790784562.562642:0:14317:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.132@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1790784562.562647:0:14317:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790784562.562649:0:14317:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790784562.562650:0:14317:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790784562.562652:0:14317:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790784562.562653:0:14317:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790784562.562654:0:14317:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790784562.562656:0:14317:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790784562.562657:0:14317:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790784562.562658:0:14317:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790784562.562659:0:14317:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790784562.562662:0:14317:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1790784562.562664:0:14317:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790784562.562665:0:14317:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790784562.562666:0:14317:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790784562.562667:0:14317:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790784562.562668:0:14317:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790784562.562669:0:14317:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790784562.562670:0:14317:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790784562.562671:0:14317:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790784562.562672:0:14317:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790784562.562673:0:14317:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790784562.562997:0:14317:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790784562.563018:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d346a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14317:1877773359599232:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790784562.563092:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784562.563166:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905788c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790784562.563411:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359599232 00000100:00100000:1.0:1790784562.563419:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359599232 00000100:00100000:1.0:1790784562.563469:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790784562.563479:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459366fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+5:14317:x1877773359599232:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790784562.563686:0:14330:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790784562.563689:0:14330:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1790784562.563692:0:14330:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1790784562.564447:0:14351:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1790784562.565251:0:14330:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1790784562.569585:0:14352:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1790784562.569594:0:14352:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1790784562.569597:0:14352:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1790784562.569635:0:14352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1790784562.574865:0:14330:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790784562.574878:0:14330:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1790784562.580867:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459366fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+5:14317:x1877773359599232:12345-0@lo:253:mount.lustre.0 Request processed in 17382us (17767us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784562.580886:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790784562.581157:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d346a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14317:1877773359599232:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790784562.581173:0:14317:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1790784562.581177:0:14317:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790784562.581178:0:14317:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790784562.581180:0:14317:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790784562.581181:0:14317:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790784562.581182:0:14317:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790784562.581184:0:14317:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790784562.581185:0:14317:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790784562.581186:0:14317:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790784562.581188:0:14317:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790784562.581190:0:14317:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790784562.581208:0:14317:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94593c4ab000 from lustre-MDT0000 10000000:01000000:3.0:1790784562.581236:0:14317:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1790784562.581239:0:14317:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790784562.581244:0:14317:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff94590574cd40 10000000:01000000:3.0:1790784562.581249:0:14317:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790784562.581257:0:14317:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff94590574cd40 from 1 10000000:01000000:3.0:1790784562.581260:0:14317:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790784562.581329:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945802d2fe00/0x2c3a1e2a079d4691 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784562.581350:0:14317:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff945802d2fe00/0x2c3a1e2a079d4691 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784562.581360:0:14317:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff945802d2fe00/0x2c3a1e2a079d4691 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784562.581421:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d346a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14317:1877773359599360:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790784562.581461:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784562.581727:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905788480 going to sleep for 11 seconds 00000100:00100000:0.0:1790784562.582115:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359599360 00000100:00100000:0.0:1790784562.582121:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359599360 00000100:00100000:0.0:1790784562.582155:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790784562.582163:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459366fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+5:14317:x1877773359599360:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790784562.582183:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784562.582196:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94593c1b0e00/0x2c3a1e2a079d4698 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d4691 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784562.582219:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94593c1b0e00/0x2c3a1e2a079d4698 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d4691 expref: 6 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784562.582230:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94593c1b0e00/0x2c3a1e2a079d4698 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d4691 expref: 6 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784562.582238:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b0e00, rc 0) 00000100:00100000:0.0:1790784562.582300:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459366fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+6:14317:x1877773359599360:12345-0@lo:101:mount.lustre.0 Request processed in 137us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784562.582307:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790784562.582487:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d346a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14317:1877773359599360:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790784562.582516:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff945802d2fe00/0x2c3a1e2a079d4691 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4698 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784562.582525:0:14317:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff945802d2fe00/0x2c3a1e2a079d4691 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d4698 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784562.582579:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14317:1877773359599488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790784562.582610:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784562.582633:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905596180 going to sleep for 11 seconds 00000100:00100000:3.0:1790784562.582960:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359599488 00000100:00100000:3.0:1790784562.582966:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359599488 00000100:00100000:3.0:1790784562.583002:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790784562.583009:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459366fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+6:14317:x1877773359599488:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790784562.583228:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459366fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+6:14317:x1877773359599488:12345-0@lo:501:mount.lustre.0 Request processed in 218us (616us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790784562.583235:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790784562.583709:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14317:1877773359599488:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1790784562.583737:0:14317:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790784562.583756:0:14317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945802d2fe00/0x2c3a1e2a079d4691 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4698 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784562.583765:0:14317:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff945802d2fe00/0x2c3a1e2a079d4691 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4698 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790784562.583787:0:14317:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94593c4ab000 10000000:01000000:1.0:1790784562.583791:0:14317:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790784562.583795:0:14317:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff94593c4ab000 10000000:01000000:1.0:1790784562.584040:0:14317:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1790784562.584097:0:14317:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff94593c4ab000 from 1 10000000:01000000:0.0:1790784562.584101:0:14317:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1790784562.584130:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff94593c1b0a00/0x2c3a1e2a079d469f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784562.584137:0:14317:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff94593c1b0a00/0x2c3a1e2a079d469f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784562.584146:0:14317:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff94593c1b0a00/0x2c3a1e2a079d469f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784562.584161:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14317:1877773359599616:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790784562.584193:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784562.584226:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff945903bc53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790784562.584277:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359599616 00000100:00100000:3.0:1790784562.584295:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359599616 00000100:00100000:3.0:1790784562.584347:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790784562.584356:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459366ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+6:14317:x1877773359599616:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790784562.584366:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784562.584416:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945802d2fa00/0x2c3a1e2a079d46a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d469f expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784562.584435:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945802d2fa00/0x2c3a1e2a079d46a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d469f expref: 7 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784562.584444:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945802d2fa00/0x2c3a1e2a079d46a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d469f expref: 7 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784562.584452:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945802d2fa00, rc 0) 00000100:00100000:3.0:1790784562.584602:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459366ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+7:14317:x1877773359599616:12345-0@lo:101:mount.lustre.0 Request processed in 135us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784562.584611:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790784562.584708:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14317:1877773359599616:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790784562.584721:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff94593c1b0a00/0x2c3a1e2a079d469f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d46a6 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784562.584730:0:14317:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff94593c1b0a00/0x2c3a1e2a079d469f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d46a6 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790784562.584743:0:14317:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1790784562.584747:0:14317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff94593c1b0a00/0x2c3a1e2a079d469f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d46a6 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784562.584754:0:14317:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff94593c1b0a00/0x2c3a1e2a079d469f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d46a6 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790784562.584759:0:14317:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790784562.584763:0:14317:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790784562.584767:0:14317:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff94593c4ab000 10000000:01000000:1.0:1790784562.584770:0:14317:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1790784562.584773:0:14317:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1790784562.584775:0:14317:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790784562.584790:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d46ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784562.584945:0:14317:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d46ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784562.584963:0:14317:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d46ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784562.584976:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14317:1877773359599744:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790784562.585004:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784562.585022:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905596180 going to sleep for 11 seconds 00000100:00100000:0.0:1790784562.585197:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359599744 00000100:00100000:0.0:1790784562.585209:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359599744 00000100:00100000:0.0:1790784562.585246:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790784562.585254:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459366fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+7:14317:x1877773359599744:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790784562.585262:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784562.585270:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94593c1b1a00/0x2c3a1e2a079d46b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d46ad expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784562.585298:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94593c1b1a00/0x2c3a1e2a079d46b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d46ad expref: 8 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784562.585307:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94593c1b1a00/0x2c3a1e2a079d46b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d46ad expref: 8 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784562.585323:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b1a00, rc 0) 00000100:00100000:0.0:1790784562.585452:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459366fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+8:14317:x1877773359599744:12345-0@lo:101:mount.lustre.0 Request processed in 198us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784562.585458:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790784562.585623:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14317:1877773359599744:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790784562.585634:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d46ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d46b4 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784562.585643:0:14317:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d46ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d46b4 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784562.585688:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14317:1877773359599872:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790784562.585712:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784562.585728:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905596180 going to sleep for 11 seconds 00000100:00100000:3.0:1790784562.585934:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359599872 00000100:00100000:3.0:1790784562.585939:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359599872 00000100:00100000:3.0:1790784562.585973:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790784562.585980:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459366fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+8:14317:x1877773359599872:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790784562.586672:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459366fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+9:14317:x1877773359599872:12345-0@lo:501:mount.lustre.0 Request processed in 692us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784562.586681:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790784562.588734:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14317:1877773359599872:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790784562.588797:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14317:1877773359600000:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790784562.588867:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784562.588909:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905596180 going to sleep for 11 seconds 00000100:00100000:2.0:1790784562.589028:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359600000 00000100:00100000:2.0:1790784562.589035:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359600000 00000100:00100000:2.0:1790784562.589085:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790784562.589094:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459366ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+9:14317:x1877773359600000:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790784562.589727:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14317:1877773359600000:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790784562.590362:0:14353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14353:1877773359600128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790784562.590464:0:14353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784562.590502:0:14353:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905596540 going to sleep for 11 seconds 00000100:00100000:0.0:1790784562.590605:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359600128 00000100:00100000:0.0:1790784562.590612:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359600128 00000100:00100000:0.0:1790784562.590641:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790784562.590649:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459366ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+10:14353:x1877773359600128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790784562.590927:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459366ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+10:14353:x1877773359600128:12345-0@lo:502:llog_process_th.0 Request processed in 278us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784562.590935:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790784562.591094:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459366ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+9:14317:x1877773359600000:12345-0@lo:503:mount.lustre.0 Request processed in 397us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784562.591114:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790784562.593583:0:14353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14353:1877773359600128:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790784562.593631:0:14353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790784562.593645:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790784562.593648:0:14353:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790784562.593653:0:14353:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1790784562.593657:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790784562.593674:0:14353:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff94592d5db380) 00000020:00000080:1.0:1790784562.593692:0:14353:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1790784562.593698:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1790784562.593792:0:14353:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1790784562.593811:0:14353:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2c3a1e2a079d46c2 00000020:00000080:1.0:1790784562.594018:0:14353:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1790784562.594022:0:14353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790784562.594026:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790784562.594028:0:14353:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790784562.594030:0:14353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790784562.594033:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790784562.594034:0:14353:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1790784562.594037:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790784562.594044:0:14353:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff94592d5d8000) 00000020:00000080:1.0:1790784562.594052:0:14353:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1790784562.594055:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1790784562.594057:0:14353:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1790784562.594060:0:14353:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1790784562.594065:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790784562.594103:0:14353:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94593c4ab000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1790784562.594115:0:14353:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff94592d5dcd40) 00000020:00000080:1.0:1790784562.594125:0:14353:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1790784562.594179:0:14353:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1790784562.594186:0:14353:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2c3a1e2a079d46d7 00000020:00000080:1.0:1790784562.594277:0:14353:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1790784562.594298:0:14353:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1790784562.594309:0:14353:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2c3a1e2a079d46de 00080000:01000000:1.0:1790784562.594315:0:14353:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1790784562.594331:0:14353:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2c3a1e2a079d46e5 00010000:00010000:3.0:1790784562.701985:0:14353:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1790784562.702950:0:14353:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:3.0:1790784562.703297:0:14353:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1790784562.704465:0:14353:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff94592d4c8000) 00000020:00000080:3.0:1790784562.704486:0:14353:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1790784562.705075:0:14353:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1790784562.705084:0:14353:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2c3a1e2a079d46f3 00000020:00000080:2.0:1790784562.708730:0:14353:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1790784562.713144:0:14353:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2c3a1e2a079d46fa 00000020:00000080:2.0:1790784562.714105:0:14353:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1790784562.714116:0:14353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790784562.714122:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784562.714124:0:14353:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1790784562.714127:0:14353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790784562.714130:0:14353:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1790784562.714131:0:14353:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790784562.714132:0:14353:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790784562.714134:0:14353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790784562.714136:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784562.714137:0:14353:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790784562.714140:0:14353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790784562.714144:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784562.714145:0:14353:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1790784562.714149:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1790784562.714183:0:14353:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1790784562.714195:0:14353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790784562.714197:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784562.714199:0:14353:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1790784562.714201:0:14353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790784562.714204:0:14353:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1790784562.714207:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784562.714209:0:14353:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1790784562.714212:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790784562.714217:0:14353:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.132@tcp to nid 0x20000c0a8ce84 (192.168.206.132@tcp) 00000020:01000000:2.0:1790784562.714240:0:14353:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790784562.714249:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790784562.714263:0:14353:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff94593c4a19c0) 00000020:00000080:2.0:1790784562.714277:0:14353:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1790784562.714293:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790784562.714797:0:14353:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1790784562.714804:0:14353:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1790784562.714812:0:14353:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2c3a1e2a079d4708 00010000:00080000:2.0:1790784562.714852:0:14353:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9459103c5800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.132@tcp at head 00010000:00010000:2.0:1790784562.715067:0:14353:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1790784562.715991:0:14353:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790784562.716037:0:14353:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790784562.719883:0:14353:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790784562.719967:0:14353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1790784562.720061:0:14353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1790784562.721034:0:14357:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790784562.721039:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1790784562.722008:0:14353:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790784562.722020:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790784562.722052:0:14353:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1790784562.722071:0:14353:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2c3a1e2a079d470f 00000100:00080000:2.0:1790784562.722082:0:14353:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790784562.722093:0:14353:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9459103c5800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:2.0:1790784562.722129:0:14353:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94592d9cce00 x1877773359600256/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790784562.722156:0:14353:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1790784562.722208:0:14353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790784562.722213:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784562.722215:0:14353:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1790784562.722218:0:14353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790784562.722221:0:14353:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1790784562.722228:0:14353:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790784562.722230:0:14353:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790784562.722232:0:14353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790784562.722234:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784562.722236:0:14353:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790784562.722239:0:14353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790784562.722243:0:14353:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1790784562.722247:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784562.722248:0:14353:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1790784562.722251:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790784562.722255:0:14353:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.132@tcp to nid 0x20000c0a8ce84 (192.168.206.132@tcp) 00000020:01000000:2.0:1790784562.722277:0:14353:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790784562.722280:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790784562.722303:0:14353:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff94593c4a4d40) 00000020:00000080:2.0:1790784562.722315:0:14353:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1790784562.722331:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1790784562.723226:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1877773359600256:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1790784562.723277:0:3278:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877773359600256 offset 0 length 520: 4 00000004:00080000:2.0:1790784562.723992:0:14353:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1790784562.724000:0:14353:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1790784562.724008:0:14353:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2c3a1e2a079d471d 00010000:00080000:2.0:1790784562.724041:0:14353:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94591a8a3000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.132@tcp at head 00010000:00010000:2.0:1790784562.724261:0:14353:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1790784562.725403:0:14353:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790784562.725430:0:14353:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790784562.726210:0:14353:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790784562.726279:0:14353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1790784562.726397:0:14353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1790784562.730360:0:14359:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790784562.730366:0:14359:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1790784562.732132:0:14353:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790784562.732146:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790784562.732182:0:14353:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1790784562.732203:0:14353:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2c3a1e2a079d4724 00000100:00080000:2.0:1790784562.732219:0:14353:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790784562.732230:0:14353:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94591a8a3000 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:2.0:1790784562.732274:0:14353:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94592d9cc700 x1877773359600384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790784562.732357:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1877773359600384:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1790784562.732436:0:3278:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877773359600384 offset 0 length 520: 4 00000100:00080000:2.0:1790784562.732617:0:14353:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1790784562.732665:0:14353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790784562.732671:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784562.732804:0:14353:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1790784562.732810:0:14353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790784562.732886:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784562.732889:0:14353:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790784562.732895:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790784562.732897:0:14353:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790784562.732900:0:14353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790784562.732902:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784562.732904:0:14353:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790784562.732906:0:14353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790784562.732908:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784562.732909:0:14353:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790784562.732913:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1790784562.732941:0:14353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9ce680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14353:1877773359600512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790784562.732987:0:14353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784562.733011:0:14353:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593fe4a780 going to sleep for 11 seconds 00000100:00100000:0.0:1790784562.733296:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359600512 00000100:00100000:0.0:1790784562.733303:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359600512 00000100:00100000:0.0:1790784562.733361:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790784562.733370:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459366fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+9:14353:x1877773359600512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790784562.733968:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459366fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+9:14353:x1877773359600512:12345-0@lo:502:llog_process_th.0 Request processed in 598us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784562.733977:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790784562.734034:0:14353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9ce680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14353:1877773359600512:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790784562.734061:0:14353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790784562.734067:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790784562.734069:0:14353:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790784562.734074:0:14353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1790784562.734119:0:14317:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1790784562.734138:0:14317:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790784562.734152:0:14317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d46ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d46b4 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784562.734163:0:14317:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff945900031600/0x2c3a1e2a079d46ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d46b4 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790784562.734172:0:14317:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94593c4ab000 from 1 10000000:01000000:0.0:1790784562.734174:0:14317:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790784562.734201:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff94593c1b1e00/0x2c3a1e2a079d472b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784562.734210:0:14317:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff94593c1b1e00/0x2c3a1e2a079d472b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784562.734220:0:14317:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff94593c1b1e00/0x2c3a1e2a079d472b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784562.734235:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14317:1877773359600640:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790784562.734275:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784562.734310:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff945911e9c180 going to sleep for 11 seconds 00000100:00100000:2.0:1790784562.735146:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359600640 00000100:00100000:2.0:1790784562.735154:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359600640 00000100:00100000:2.0:1790784562.735205:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790784562.735214:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459366fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+9:14317:x1877773359600640:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790784562.735227:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784562.735245:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94593fe74200/0x2c3a1e2a079d4732 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d472b expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784562.735292:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94593fe74200/0x2c3a1e2a079d4732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d472b expref: 10 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784562.735303:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94593fe74200/0x2c3a1e2a079d4732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d472b expref: 10 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784562.735312:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74200, rc 0) 00000100:00100000:2.0:1790784562.735398:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459366fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+10:14317:x1877773359600640:12345-0@lo:101:mount.lustre.0 Request processed in 185us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784562.735405:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790784562.736307:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14317:1877773359600640:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790784562.736335:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff94593c1b1e00/0x2c3a1e2a079d472b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4732 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784562.736354:0:14317:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff94593c1b1e00/0x2c3a1e2a079d472b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d4732 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784562.738181:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14317:1877773359600768:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1790784562.738257:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784562.738308:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff945911e9c180 going to sleep for 11 seconds 00000100:00100000:2.0:1790784562.738706:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359600768 00000100:00100000:2.0:1790784562.738715:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359600768 00000100:00100000:2.0:1790784562.738763:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790784562.738773:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+10:14317:x1877773359600768:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1790784562.738791:0:14330:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1790784562.738797:0:14330:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1790784562.738880:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+10:14317:x1877773359600768:12345-0@lo:256:mount.lustre.0 Request processed in 109us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784562.738888:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790784562.739956:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14317:1877773359600768:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1790784562.741078:0:14317:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790784562.741134:0:14317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff94593c1b1e00/0x2c3a1e2a079d472b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4732 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784562.741146:0:14317:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff94593c1b1e00/0x2c3a1e2a079d472b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4732 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790784562.741155:0:14317:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94593c4ab000 from 1 10000000:01000000:0.0:1790784562.741157:0:14317:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790784562.741201:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff94593c1b0000/0x2c3a1e2a079d4739 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784562.741209:0:14317:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff94593c1b0000/0x2c3a1e2a079d4739 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784562.741232:0:14317:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff94593c1b0000/0x2c3a1e2a079d4739 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784562.741252:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14317:1877773359600896:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790784562.741312:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784562.741361:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff945911e9c180 going to sleep for 11 seconds 00000100:00100000:1.0:1790784562.742012:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359600896 00000100:00100000:1.0:1790784562.742021:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359600896 00000100:00100000:1.0:1790784562.742068:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790784562.742076:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+10:14317:x1877773359600896:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790784562.742087:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784562.742101:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945900031800/0x2c3a1e2a079d4740 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d4739 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784562.742121:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945900031800/0x2c3a1e2a079d4740 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d4739 expref: 11 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784562.742130:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945900031800/0x2c3a1e2a079d4740 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d4739 expref: 11 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784562.742138:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945900031800, rc 0) 00000100:00100000:1.0:1790784562.742187:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+11:14317:x1877773359600896:12345-0@lo:101:mount.lustre.0 Request processed in 112us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784562.742193:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790784562.742657:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14317:1877773359600896:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790784562.742729:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff94593c1b0000/0x2c3a1e2a079d4739 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4740 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784562.742740:0:14317:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff94593c1b0000/0x2c3a1e2a079d4739 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d4740 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784562.742801:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14317:1877773359601024:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790784562.742896:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784562.742929:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905788d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790784562.742979:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359601024 00000100:00100000:0.0:1790784562.742984:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359601024 00000100:00100000:0.0:1790784562.743019:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790784562.743026:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d728850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+11:14317:x1877773359601024:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790784562.744197:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d728850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+11:14317:x1877773359601024:12345-0@lo:501:mount.lustre.0 Request processed in 1167us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784562.744208:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790784562.744660:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14317:1877773359601024:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790784562.744777:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14317:1877773359601152:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790784562.744899:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784562.744966:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905788d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790784562.745990:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359601152 00000100:00100000:0.0:1790784562.746001:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359601152 00000100:00100000:0.0:1790784562.746092:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790784562.746102:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+11:14317:x1877773359601152:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790784562.746326:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+11:14317:x1877773359601152:12345-0@lo:503:mount.lustre.0 Request processed in 225us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784562.746334:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790784562.746467:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14317:1877773359601152:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790784562.747069:0:14361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14361:1877773359601280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790784562.747125:0:14361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784562.747851:0:14361:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905788f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790784562.748001:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359601280 00000100:00100000:1.0:1790784562.748007:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359601280 00000100:00100000:1.0:1790784562.748039:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790784562.748047:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+11:14361:x1877773359601280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790784562.748812:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+11:14361:x1877773359601280:12345-0@lo:502:llog_process_th.0 Request processed in 763us (1683us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784562.748891:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790784562.749041:0:14361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14361:1877773359601280:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790784562.749085:0:14361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790784562.749094:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790784562.749096:0:14361:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790784562.749104:0:14361:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94593c4ab000 00000020:00000080:3.0:1790784562.749107:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790784562.749115:0:14361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790784562.749118:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790784562.749119:0:14361:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1790784562.749121:0:14361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790784562.749124:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790784562.749126:0:14361:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790784562.749129:0:14361:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94593c4ab000 00000020:00000080:3.0:1790784562.749131:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790784562.749195:0:14361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790784562.749198:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790784562.749200:0:14361:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1790784562.749202:0:14361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790784562.749204:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790784562.749206:0:14361:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790784562.749209:0:14361:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94593c4ab000 00000020:00000080:3.0:1790784562.749211:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790784562.749252:0:14361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14361:1877773359601408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790784562.749309:0:14361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784562.749350:0:14361:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905788f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790784562.749823:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359601408 00000100:00100000:0.0:1790784562.749830:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359601408 00000100:00100000:0.0:1790784562.749866:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790784562.749873:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+11:14361:x1877773359601408:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790784562.750039:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+11:14361:x1877773359601408:12345-0@lo:502:llog_process_th.0 Request processed in 164us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784562.750051:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790784562.751279:0:14361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14361:1877773359601408:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790784562.751812:0:14361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790784562.751900:0:14361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790784562.751903:0:14361:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1790784562.751909:0:14361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1790784562.753592:0:14317:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1790784562.753621:0:14317:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790784562.753640:0:14317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff94593c1b0000/0x2c3a1e2a079d4739 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4740 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784562.753652:0:14317:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff94593c1b0000/0x2c3a1e2a079d4739 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4740 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790784562.753711:0:14317:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790784562.753714:0:14317:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94593c4ab000 10000000:01000000:2.0:1790784562.753717:0:14317:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94593c4ab000 10000000:01000000:2.0:1790784562.753721:0:14317:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790784562.753725:0:14317:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94593c4ab000 from 1 10000000:01000000:2.0:1790784562.753728:0:14317:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790784562.753767:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff94593fe75600/0x2c3a1e2a079d4747 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784562.753775:0:14317:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff94593fe75600/0x2c3a1e2a079d4747 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784562.753786:0:14317:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff94593fe75600/0x2c3a1e2a079d4747 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784562.753809:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14317:1877773359601536:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790784562.754015:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784562.754052:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593fe4a540 going to sleep for 11 seconds 00000100:00100000:0.0:1790784562.766485:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359601536 00000100:00100000:0.0:1790784562.766507:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359601536 00000100:00100000:0.0:1790784562.770131:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790784562.770151:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+11:14317:x1877773359601536:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790784562.770180:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784562.770200:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94593c1b1200/0x2c3a1e2a079d474e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d4747 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784562.770231:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94593c1b1200/0x2c3a1e2a079d474e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d4747 expref: 12 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784562.770242:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94593c1b1200/0x2c3a1e2a079d474e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d4747 expref: 12 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784562.770250:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b1200, rc 0) 00000100:00100000:0.0:1790784562.770340:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+12:14317:x1877773359601536:12345-0@lo:101:mount.lustre.0 Request processed in 197us (16325us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784562.770348:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790784562.774198:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14317:1877773359601536:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790784562.774227:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff94593fe75600/0x2c3a1e2a079d4747 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d474e expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784562.774241:0:14317:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff94593fe75600/0x2c3a1e2a079d4747 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d474e expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784562.774350:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14317:1877773359601664:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790784562.774421:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784562.789708:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359601664 00000100:00100000:2.0:1790784562.789722:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359601664 00000100:00100000:2.0:1790784562.790074:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790784562.790084:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+12:14317:x1877773359601664:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790784562.791109:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+12:14317:x1877773359601664:12345-0@lo:501:mount.lustre.0 Request processed in 1023us (16684us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784562.791119:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790784562.803349:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905788f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790784562.803402:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14317:1877773359601664:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790784562.803460:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14317:1877773359601792:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790784562.806025:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784562.806079:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905788f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790784562.806715:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359601792 00000100:00100000:2.0:1790784562.806725:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359601792 00000100:00100000:2.0:1790784562.806776:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790784562.806793:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d729450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+12:14317:x1877773359601792:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790784562.807012:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d729450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+12:14317:x1877773359601792:12345-0@lo:503:mount.lustre.0 Request processed in 220us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784562.807020:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790784562.807350:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14317:1877773359601792:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790784562.811069:0:14366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14366:1877773359601920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790784562.818859:0:14366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784562.818914:0:14366:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905788d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790784562.819034:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359601920 00000100:00100000:1.0:1790784562.819045:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359601920 00000100:00100000:1.0:1790784562.819098:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790784562.819109:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+12:14366:x1877773359601920:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790784562.819365:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+12:14366:x1877773359601920:12345-0@lo:502:llog_process_th.0 Request processed in 258us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784562.819392:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790784562.820549:0:14366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14366:1877773359601920:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1790784562.820621:0:14366:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1790784562.820637:0:14366:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff94592d4ccd40) 00000020:00000080:3.0:1790784562.820655:0:14366:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1790784562.820764:0:14366:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94593c4ab000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1790784562.820768:0:14366:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94593c4ab000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1790784562.820770:0:14366:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94593c4ab000 4 00010000:00080000:3.0:1790784562.820809:0:14366:0:(ldlm_lib.c:102:import_set_conn()) imp ffff945902bed000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.132@tcp at head 00010000:00010000:3.0:1790784562.825148:0:14366:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1790784562.826575:0:14366:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1790784562.826611:0:14366:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790784562.826625:0:14366:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2c3a1e2a079d475c 00000100:00080000:3.0:1790784562.826634:0:14366:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790784562.826645:0:14366:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff945902bed000 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:3.0:1790784562.826682:0:14366:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94592d344380 x1877773359602048/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790784562.826706:0:14366:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790784562.835837:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3278:1877773359602048:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790784562.835912:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784562.836089:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359602048 00000100:00100000:0.0:1790784562.836097:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359602048 00000100:00100000:0.0:1790784562.836137:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790784562.836143:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3278:x1877773359602048:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790784562.836674:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3278:x1877773359602048:12345-0@lo:38:llog_process_th.0 Request processed in 528us (759us total) trans 0 rc -11/-11 00000100:00100000:0.0:1790784562.836682:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790784562.837950:0:3278:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790784562.837961:0:3278:0:(import.c:65:import_set_state_nolock()) ffff945902bed000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790784562.837966:0:3278:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1790784562.837970:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3278:1877773359602048:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790784562.838082:0:14366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14366:1877773359602176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790784562.838136:0:14366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784562.838178:0:14366:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905788240 going to sleep for 11 seconds 00000100:00100000:3.0:1790784562.838194:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359602176 00000100:00100000:3.0:1790784562.838198:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359602176 00000100:00100000:3.0:1790784562.838234:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790784562.838243:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+12:14366:x1877773359602176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790784562.838601:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+12:14366:x1877773359602176:12345-0@lo:502:llog_process_th.0 Request processed in 358us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784562.838609:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790784562.838650:0:14366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14366:1877773359602176:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1790784562.838672:0:14366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1790784562.840917:0:14317:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1790784562.840940:0:14317:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790784562.840957:0:14317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff94593fe75600/0x2c3a1e2a079d4747 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d474e expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784562.840968:0:14317:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff94593fe75600/0x2c3a1e2a079d4747 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d474e expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790784562.841013:0:14317:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790784562.841016:0:14317:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790784562.841018:0:14317:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790784562.841019:0:14317:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790784562.841020:0:14317:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790784562.841021:0:14317:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790784562.841023:0:14317:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790784562.841024:0:14317:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790784562.841025:0:14317:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790784562.841026:0:14317:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790784562.841030:0:14317:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1790784562.841032:0:14317:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790784562.841033:0:14317:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790784562.841034:0:14317:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790784562.841035:0:14317:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790784562.841036:0:14317:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790784562.841037:0:14317:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790784562.841039:0:14317:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790784562.841040:0:14317:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790784562.841041:0:14317:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790784562.841267:0:14317:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790784562.841300:0:14317:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790784562.841316:0:14317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14317:1877773359602304:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790784562.841460:0:14317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784562.842294:0:14317:0:(client.c:2716:ptlrpc_set_wait()) set ffff94593fe4a180 going to sleep for 11 seconds 00000100:00100000:3.0:1790784562.853020:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359602304 00000100:00100000:3.0:1790784562.853034:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359602304 00000100:00100000:2.0:1790784562.857973:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790784562.857986:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d729850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+12:14317:x1877773359602304:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790784562.858032:0:14328:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1790784562.858101:0:14328:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1790784562.906820:0:14328:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790784562.906838:0:14328:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1790784562.906913:0:14351:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790784562.906918:0:14351:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790784562.906938:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff945900030c00/0x2c3a1e2a079d4763 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784562.906956:0:14351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94593fe74200/0x2c3a1e2a079d4732 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d472b expref: 12 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784562.906965:0:14351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff945900030c00/0x2c3a1e2a079d4763 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784562.907006:0:14351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94593fe74200/0x2c3a1e2a079d4732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d472b expref: 12 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784562.907020:0:14351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94593fe74200/0x2c3a1e2a079d4732 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d472b expref: 12 pid: 14330 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784562.907033:0:14351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa1880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14351:1877773359602432:0@lo:104: 00000100:00100000:1.0:1790784562.907092:0:14351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784562.907157:0:14351:0:(client.c:2716:ptlrpc_set_wait()) set ffff94591316f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790784562.907234:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359602432 00000100:00100000:2.0:1790784562.907242:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359602432 00000100:00100000:1.0:1790784562.907436:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790784562.907446:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592daa1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+3:14351:x1877773359602432:12345-0@lo:104: 00010000:00010000:1.0:1790784562.907460:0:14319:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff94593c1b1e00/0x2c3a1e2a079d472b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d4732 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784562.907510:0:14319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790784562.907516:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592daa1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+3:14351:x1877773359602432:12345-0@lo:104: Request processed in 72us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784562.907523:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1790784562.907650:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790784562.907656:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff94593c1b1e00/0x2c3a1e2a079d472b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d4732 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784562.907664:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b1e00 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:1.0:1790784562.907668:0:14324:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff94593c1b1e00/0x2c3a1e2a079d472b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d4732 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784562.907675:0:14324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff94593c1b1e00/0x2c3a1e2a079d472b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d4732 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790784562.907682:0:14324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff94593c1b1e00/0x2c3a1e2a079d472b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d4732 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790784562.907688:0:14324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790784562.907759:0:14324:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff94593c1b1e00/0x2c3a1e2a079d472b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d4732 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784562.907766:0:14324:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790784562.907785:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff94593c1b1e00/0x2c3a1e2a079d472b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d4732 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784562.907797:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff94593c1b1e00/0x2c3a1e2a079d472b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d4732 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784562.907813:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784562.907814:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784562.907816:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790784562.907851:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3282:1877773359602560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790784562.907879:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784562.907930:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359602560 00000100:00100000:3.0:1790784562.907935:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359602560 00000100:00100000:1.0:1790784562.907947:0:14351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa1880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14351:1877773359602432:0@lo:104: 00010000:00010000:3.0:1790784562.907951:0:14320:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94593fe74200/0x2c3a1e2a079d4732 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d472b expref: 13 pid: 14330 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784562.907963:0:14351:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff945900030c00/0x2c3a1e2a079d4763 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784562.907970:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790784562.907976:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592daa2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+13:3282:x1877773359602560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790784562.907986:0:14320:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784562.907991:0:14320:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94593fe74200/0x2c3a1e2a079d4732 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d472b expref: 13 pid: 14330 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784562.908001:0:14320:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94593fe74200/0x2c3a1e2a079d4732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d472b expref: 13 pid: 14330 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784562.908014:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94593fe74200/0x2c3a1e2a079d4732 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d472b expref: 13 pid: 14330 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784562.908026:0:14320:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff945900030c00/0x2c3a1e2a079d4763 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784562.908033:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945900030c00/0x2c3a1e2a079d4763 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790784562.908054:0:14320:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001137087s 00010000:00010000:3.0:1790784562.908059:0:14320:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff945900030c00/0x2c3a1e2a079d4763 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784562.908066:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff945900030c00/0x2c3a1e2a079d4763 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784562.908072:0:14320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff945900030c00/0x2c3a1e2a079d4763 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784562.908079:0:14320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff945900030c00/0x2c3a1e2a079d4763 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784562.908084:0:14320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030c00 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:3.0:1790784562.908087:0:14320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff945900030c00/0x2c3a1e2a079d4763 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784562.908095:0:14320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff945900030c00/0x2c3a1e2a079d4763 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784562.908116:0:14320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff945900030c00/0x2c3a1e2a079d4763 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784562.908125:0:14320:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790784562.908155:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592daa2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+12:3282:x1877773359602560:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784562.908161:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790784562.909588:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3282:1877773359602560:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790784562.909618:0:14351:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff945900030c00/0x2c3a1e2a079d4763 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784562.909628:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff945900030c00/0x2c3a1e2a079d4763 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784562.909635:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945900030c00/0x2c3a1e2a079d4763 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784562.924447:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d729850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+11:14317:x1877773359602304:12345-0@lo:253:mount.lustre.0 Request processed in 66455us (83062us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784562.924476:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790784562.924640:0:14317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14317:1877773359602304:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790784562.924655:0:14317:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790784562.924658:0:14317:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790784562.924661:0:14317:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790784562.924662:0:14317:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790784562.924663:0:14317:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790784562.924665:0:14317:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790784562.924666:0:14317:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790784562.924667:0:14317:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790784562.924669:0:14317:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790784562.924670:0:14317:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790784562.924672:0:14317:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790784562.924684:0:14317:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790784562.929585:0:14317:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1790784562.929776:0:14317:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790784562.930057:0:14317:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1790784562.930211:0:14317:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790784562.930536:0:14317:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1790784562.930690:0:14317:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1790784562.934560:0:14317:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1790784562.935043:0:14317:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1790784562.935488:0:14317:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1790784562.935797:0:14317:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1790784562.936053:0:14317:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1790784562.936219:0:14317:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1790784562.962403:0:14317:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1790784562.962739:0:14317:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1790784562.962813:0:14374:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1790784562.962817:0:14374:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1790784562.963179:0:14375:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1790784562.963238:0:14375:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790784562.965750:0:14375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1790784562.965828:0:14375:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1790784562.965832:0:14375:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1790784562.967732:0:14317:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1790784562.967850:0:14317:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1790784562.968464:0:14317:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1790784562.968473:0:14317:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1790784562.968594:0:14317:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790784562.969871:0:14317:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1790784562.970644:0:14317:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1790784562.970679:0:14317:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1790784562.972101:0:14317:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1790784562.976808:0:14317:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1790784563.015296:0:14317:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1790784563.015416:0:14317:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffae2cc1c53988 00100000:10000000:3.0:1790784563.015424:0:14317:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1790784563.016448:0:14317:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790784563.016464:0:14317:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.132@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790784563.016479:0:14317:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1790784563.016511:0:14317:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1790784563.323500:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790784563.644440:0:14333:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790784563.644448:0:14333:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94593c4ab000 from 6 10000000:01000000:2.0:1790784563.644452:0:14333:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790784563.644501:0:14333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff94593fe74400/0x2c3a1e2a079d476a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784563.644514:0:14333:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff94593fe74400/0x2c3a1e2a079d476a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784563.644526:0:14333:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff94593fe74400/0x2c3a1e2a079d476a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784563.644565:0:14333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359602688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790784563.644631:0:14333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784563.644708:0:14333:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910ff90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790784563.647450:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359602688 00000100:00100000:3.0:1790784563.647465:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359602688 00000100:00100000:3.0:1790784563.647531:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790784563.647541:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+11:14333:x1877773359602688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790784563.647556:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784563.647574:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945802d2ea00/0x2c3a1e2a079d4771 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d476a expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784563.647601:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945802d2ea00/0x2c3a1e2a079d4771 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d476a expref: 12 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784563.647613:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945802d2ea00/0x2c3a1e2a079d4771 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d476a expref: 12 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784563.647621:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945802d2ea00, rc 0) 00000100:00100000:3.0:1790784563.647695:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+12:14333:x1877773359602688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (3064us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784563.647702:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790784563.648225:0:14333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359602688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790784563.648243:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff94593fe74400/0x2c3a1e2a079d476a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4771 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784563.648254:0:14333:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff94593fe74400/0x2c3a1e2a079d476a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d4771 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784563.648334:0:14333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359602816:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790784563.648417:0:14333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784563.648444:0:14333:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910ff90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790784563.648525:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359602816 00000100:00100000:0.0:1790784563.648530:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359602816 00000100:00100000:0.0:1790784563.648567:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790784563.648574:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+12:14333:x1877773359602816:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790784563.648590:0:14328:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790784563.648606:0:14328:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790784563.648609:0:14328:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1790784563.648695:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+12:14333:x1877773359602816:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 121us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784563.648703:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790784563.648876:0:14333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359602816:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790784563.648913:0:14333:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790784563.648921:0:14333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff94593fe74400/0x2c3a1e2a079d476a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4771 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784563.648929:0:14333:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff94593fe74400/0x2c3a1e2a079d476a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4771 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790784563.900960:0:14368:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790784564.348022:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790784564.934133:0:14368:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790784565.374792:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784566.396493:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784567.418754:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790784567.995616:0:14618:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg632-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1790784568.251569:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790784568.251576:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790784568.251578:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790784568.251581:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790784568.251583:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790784568.251586:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:2.0:1790784568.251595:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3279:1877773359602944:0@lo:400:kworker.0 00000100:00080000:3.0:1790784568.251597:0:37:0:(import.c:65:import_set_state_nolock()) ffff945902bed000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790784568.251613:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff945902bed000 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:3.0:1790784568.251637:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94592d344000 x1877773359603072/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790784568.251662:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784568.251732:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359602944 00000100:00100000:2.0:1790784568.251739:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359602944 00000100:00100000:2.0:1790784568.251865:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790784568.251876:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+12:3279:x1877773359602944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784568.251927:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+12:3279:x1877773359602944:12345-0@lo:400:kworker.0 Request processed in 53us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784568.251934:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790784568.251976:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3279:1877773359602944:0@lo:400:kworker.0 00000100:00100000:3.0:1790784568.254930:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3278:1877773359603072:0@lo:38:kworker.0 00000100:00100000:3.0:1790784568.255010:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784568.257166:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359603072 00000100:00100000:1.0:1790784568.257180:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359603072 00000100:00100000:1.0:1790784568.257225:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790784568.257233:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3278:x1877773359603072:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1790784568.257271:0:14337:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 402 last 0 00000020:00000080:1.0:1790784568.257310:0:14337:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2c3a1e2a079d4778 00000004:00100000:1.0:1790784568.257325:0:14337:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790784568.257471:0:14337:0:(import.c:65:import_set_state_nolock()) ffff9459106a6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790784568.257555:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1877773359603072:12345-0@lo:38:kworker.0 Request processed in 321us (2544us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784568.257563:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790784568.273117:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94592d344000 x1877773359603072/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790784578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790784568.273138:0:3278:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1790784568.273146:0:3278:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1790784568.273151:0:3278:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790784568.273154:0:3278:0:(import.c:65:import_set_state_nolock()) ffff945902bed000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790784568.273160:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3278:1877773359603072:0@lo:38:kworker.0 00010000:00010000:2.0:1790784568.443441:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784569.467012:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784570.492916:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790784571.322632:0:14768:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc78a813e0 20000000:00000080:3.0:1790784571.322646:0:14768:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94593fafa800 uarg=0000000000000000 20000000:01000000:3.0:1790784571.322676:0:14768:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1790784571.322682:0:14768:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1790784571.322686:0:14768:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1790784571.324830:0:14770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1790784571.325044:0:14768:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790784571.341576:0:14768:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790784571.341803:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff945802d2f600/0x2c3a1e2a079d477f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784571.341822:0:14768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff945900031800/0x2c3a1e2a079d4740 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d4739 expref: 11 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784571.341831:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff945802d2f600/0x2c3a1e2a079d477f lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784571.341872:0:14768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff945900031800/0x2c3a1e2a079d4740 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d4739 expref: 11 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784571.341900:0:14768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff945900031800/0x2c3a1e2a079d4740 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d4739 expref: 11 pid: 14329 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784571.341914:0:14768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d344000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14768:1877773359603200:0@lo:104: 00000100:00100000:3.0:1790784571.341977:0:14768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784571.342066:0:14768:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905ea9900 going to sleep for 11 seconds 00000100:00100000:2.0:1790784571.343114:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359603200 00000100:00100000:2.0:1790784571.343123:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359603200 00000100:00100000:2.0:1790784571.343520:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790784571.343533:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d347100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+3:14768:x1877773359603200:12345-0@lo:104: 00010000:00010000:2.0:1790784571.343550:0:14319:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff94593c1b0000/0x2c3a1e2a079d4739 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d4740 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784571.343639:0:14319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790784571.343645:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d347100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+3:14768:x1877773359603200:12345-0@lo:104: Request processed in 117us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784571.343977:0:14768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d344000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14768:1877773359603200:0@lo:104: 00010000:00010000:1.0:1790784571.344001:0:14768:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff945802d2f600/0x2c3a1e2a079d477f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784571.344261:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1790784571.344477:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790784571.344485:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff94593c1b0000/0x2c3a1e2a079d4739 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d4740 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784571.344493:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b0000 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:3.0:1790784571.344498:0:14323:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff94593c1b0000/0x2c3a1e2a079d4739 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d4740 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784571.344507:0:14323:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff94593c1b0000/0x2c3a1e2a079d4739 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d4740 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790784571.344515:0:14323:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff94593c1b0000/0x2c3a1e2a079d4739 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d4740 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790784571.344521:0:14323:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790784571.344559:0:14323:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff94593c1b0000/0x2c3a1e2a079d4739 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d4740 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784571.344565:0:14323:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790784571.344594:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff94593c1b0000/0x2c3a1e2a079d4739 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d4740 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784571.344601:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff94593c1b0000/0x2c3a1e2a079d4739 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d4740 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784571.344682:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3280:1877773359603328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790784571.344726:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784571.344783:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359603328 00000100:00100000:1.0:1790784571.344788:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359603328 00010000:00010000:1.0:1790784571.344808:0:14321:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff945900031800/0x2c3a1e2a079d4740 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d4739 expref: 12 pid: 14329 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784571.344831:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790784571.344838:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592daa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+12:3280:x1877773359603328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790784571.344849:0:14321:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784571.344854:0:14321:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff945900031800/0x2c3a1e2a079d4740 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d4739 expref: 12 pid: 14329 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784571.344874:0:14321:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff945900031800/0x2c3a1e2a079d4740 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d4739 expref: 12 pid: 14329 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784571.344887:0:14321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945900031800/0x2c3a1e2a079d4740 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d4739 expref: 12 pid: 14329 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784571.344902:0:14321:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff945802d2f600/0x2c3a1e2a079d477f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784571.344910:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945802d2f600/0x2c3a1e2a079d477f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784571.344923:0:14321:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff945802d2f600/0x2c3a1e2a079d477f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784571.344931:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff945802d2f600/0x2c3a1e2a079d477f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784571.344938:0:14321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff945802d2f600/0x2c3a1e2a079d477f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784571.344944:0:14321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff945802d2f600/0x2c3a1e2a079d477f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784571.344948:0:14321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2f600 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:1.0:1790784571.344952:0:14321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff945802d2f600/0x2c3a1e2a079d477f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784571.344958:0:14321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff945802d2f600/0x2c3a1e2a079d477f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784571.344979:0:14321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff945802d2f600/0x2c3a1e2a079d477f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784571.344988:0:14321:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790784571.345015:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592daa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+11:3280:x1877773359603328:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784571.345022:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790784571.345048:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3280:1877773359603328:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790784571.345065:0:14768:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff945802d2f600/0x2c3a1e2a079d477f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784571.345072:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff945802d2f600/0x2c3a1e2a079d477f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784571.345079:0:14768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945802d2f600/0x2c3a1e2a079d477f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784571.346179:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784571.346181:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784571.346184:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784571.520057:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784572.354149:0:3278:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790784562/real 1790784562] req@ffff94592d9cc700 x1877773359600384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790784572 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784572.354177:0:3278:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94592d9cc700 x1877773359600384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790784572 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784572.354187:0:3278:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790784562/real 1790784562] req@ffff94592d9cce00 x1877773359600256/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790784572 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784572.354198:0:3278:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94592d9cce00 x1877773359600256/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790784572 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790784572.354215:0:3278:0:(import.c:65:import_set_state_nolock()) ffff94591a8a3000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790784572.354229:0:3278:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790784572.354254:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1877773359600384:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1790784572.354260:0:3278:0:(import.c:65:import_set_state_nolock()) ffff9459103c5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790784572.354265:0:3278:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790784572.354269:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1877773359600256:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1790784572.354328:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790784572.354332:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1790784572.354334:0:37:0:(import.c:65:import_set_state_nolock()) ffff9459103c5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790784572.354338:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 396 00000100:00080000:0.0:1790784572.354343:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790784572.354352:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9459103c5800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:0.0:1790784572.354369:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94590569ce00 x1877773359603584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790784572.354882:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790784572.354887:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790784572.354889:0:37:0:(import.c:65:import_set_state_nolock()) ffff94591a8a3000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790784572.354893:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 396 00000100:00080000:0.0:1790784572.354907:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790784572.354913:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94591a8a3000 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:0.0:1790784572.354930:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94590569f800 x1877773359603712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790784572.354964:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3281:1877773359603456:0@lo:400:kworker.0 00000100:00100000:0.0:1790784572.355023:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784572.355194:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790784572.355203:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1877773359603840:0@lo:400:kworker.0 00000100:00100000:0.0:1790784572.355326:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784572.355359:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359603840 00000100:00100000:0.0:1790784572.355366:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359603840 00000100:00100000:0.0:1790784572.355426:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790784572.355434:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1877773359603840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784572.355480:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1877773359603840:12345-0@lo:400:kworker.0 Request processed in 47us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784572.355487:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790784572.355528:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1877773359603584:0@lo:8:kworker.0 00000400:00000100:0.0:1790784572.355551:0:3278:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877773359603584 offset 0 length 520: 4 00000100:00100000:0.0:1790784572.355568:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1877773359603712:0@lo:8:kworker.0 00000400:00000100:0.0:1790784572.355582:0:3278:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877773359603712 offset 0 length 520: 4 00010000:00080000:0.0:1790784572.355609:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94590569df80 x1877773359603840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790784588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784572.355620:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1877773359603840:0@lo:400:kworker.0 00000100:00100000:3.0:1790784572.362928:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359603456 00000100:00100000:3.0:1790784572.362942:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359603456 00000100:00100000:3.0:1790784572.363955:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790784572.363971:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+11:3281:x1877773359603456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784572.366942:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+11:3281:x1877773359603456:12345-0@lo:400:kworker.0 Request processed in 2968us (11911us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784572.366957:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790784572.367118:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3281:1877773359603456:0@lo:400:kworker.0 00010000:00010000:3.0:1790784572.539461:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790784572.666904:0:14333:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790784572.666911:0:14333:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94593c4ab000 from 10 10000000:01000000:0.0:1790784572.666915:0:14333:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790784572.666971:0:14333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff94593c1b0400/0x2c3a1e2a079d4786 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784572.666984:0:14333:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff94593c1b0400/0x2c3a1e2a079d4786 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784572.666995:0:14333:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff94593c1b0400/0x2c3a1e2a079d4786 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784572.667029:0:14333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359603968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790784572.667100:0:14333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784572.667148:0:14333:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459057880c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790784572.667224:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359603968 00000100:00100000:1.0:1790784572.667242:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359603968 00000100:00100000:1.0:1790784572.667298:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790784572.667307:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+11:14333:x1877773359603968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790784572.667319:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784572.667332:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945900030800/0x2c3a1e2a079d478d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d4786 expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784572.667353:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945900030800/0x2c3a1e2a079d478d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d4786 expref: 12 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784572.667402:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945900030800/0x2c3a1e2a079d478d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d4786 expref: 12 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784572.667412:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945900030800, rc 0) 00000100:00100000:1.0:1790784572.667453:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+12:14333:x1877773359603968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784572.667460:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790784572.669399:0:14333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359603968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790784572.669424:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff94593c1b0400/0x2c3a1e2a079d4786 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d478d expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784572.669436:0:14333:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff94593c1b0400/0x2c3a1e2a079d4786 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d478d expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784572.669852:0:14333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359604096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790784572.669899:0:14333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784572.669964:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359604096 00000100:00100000:2.0:1790784572.669971:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359604096 00000100:00100000:2.0:1790784572.670012:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790784572.670021:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+12:14333:x1877773359604096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790784572.670054:0:14333:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459057880c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790784572.670290:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+12:14333:x1877773359604096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784572.670297:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790784572.671448:0:14333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359604096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790784572.671497:0:14333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359604224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790784572.671545:0:14333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784572.671580:0:14333:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459057880c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790784572.671789:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359604224 00000100:00100000:1.0:1790784572.671795:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359604224 00000100:00100000:1.0:1790784572.671839:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790784572.671848:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+12:14333:x1877773359604224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790784572.672021:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+12:14333:x1877773359604224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784572.672028:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790784572.672171:0:14333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359604224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790784572.679487:0:14828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1790784572.679569:0:14333:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1790784572.679589:0:14333:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790784572.679600:0:14333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff94593c1b0400/0x2c3a1e2a079d4786 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d478d expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784572.679621:0:14333:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff94593c1b0400/0x2c3a1e2a079d4786 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d478d expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784573.562616:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790784574.139063:0:14368:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790784574.589834:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784575.614839:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790784576.516011:0:15018:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790784576.516015:0:15018:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1790784576.516116:0:15018:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff945935d6d800 00000020:01000004:0.0:1790784576.516130:0:15018:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1790784576.516139:0:15018:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1790784576.516151:0:15018:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff945905748000) 00000020:00000080:0.0:1790784576.516165:0:15018:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1790784576.530439:0:15018:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1790784576.530701:0:15018:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1790784576.531449:0:15018:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1790784576.531694:0:15018:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1790784576.531907:0:15018:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1790784576.532254:0:15018:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 575: rc = 0 00100000:10000000:1.0:1790784576.532348:0:15018:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 575: rc = 0 00100000:10000000:1.0:1790784576.532475:0:15018:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 575: rc = 0 00100000:10000000:1.0:1790784576.532845:0:15018:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 711: rc = 0 00100000:10000000:1.0:1790784576.533150:0:15018:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 711: rc = 0 00100000:10000000:1.0:1790784576.533431:0:15018:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 711: rc = 0 00100000:10000000:0.0:1790784576.535346:0:15018:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 711: rc = 0 00100000:10000000:0.0:1790784576.535682:0:15018:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 711: rc = 0 00100000:10000000:0.0:1790784576.536251:0:15018:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 711: rc = 0 00000020:00000080:0.0:1790784576.536894:0:15018:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1790784576.536904:0:15018:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1790784576.536914:0:15018:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2c3a1e2a079d479b 00000020:01000004:0.0:1790784576.536921:0:15018:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1790784576.536940:0:15018:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.132@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1790784576.536944:0:15018:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1790784576.536949:0:15018:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1790784576.536965:0:15018:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1790784576.536977:0:15018:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9459057499c0) 00000020:00000080:0.0:1790784576.536987:0:15018:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1790784576.538041:0:15018:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790784576.538186:0:15018:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1790784576.538193:0:15018:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1790784576.540635:0:15018:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1790784576.540648:0:15018:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1790784576.544256:0:15018:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1790784576.544267:0:15018:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1790784576.545734:0:15018:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790784576.545903:0:15018:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1790784576.545909:0:15018:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1790784576.546558:0:15018:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1790784576.546566:0:15018:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1790784576.566066:0:15018:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790784576.566663:0:15018:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790784576.566670:0:15018:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1790784576.569042:0:15018:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790784576.569055:0:15018:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1790784576.570078:0:15018:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790784576.570091:0:15018:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1790784576.572743:0:15018:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790784576.573106:0:15018:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1790784576.573112:0:15018:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1790784576.573759:0:15018:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1790784576.573766:0:15018:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1790784576.620290:0:15018:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790784576.621076:0:15018:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1790784576.621084:0:15018:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1790784576.628567:0:15018:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1790784576.628584:0:15018:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1790784576.629619:0:15018:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1790784576.629643:0:15018:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1790784576.629649:0:15018:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.132@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00010000:00010000:2.0:1790784576.637440:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1790784576.658074:0:15018:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.132@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790784576.658114:0:15018:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.132@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1790784576.658118:0:15018:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790784576.658120:0:15018:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790784576.658125:0:15018:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790784576.658127:0:15018:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790784576.658128:0:15018:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790784576.658130:0:15018:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790784576.658131:0:15018:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790784576.658133:0:15018:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790784576.658134:0:15018:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790784576.658138:0:15018:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1790784576.658140:0:15018:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790784576.658141:0:15018:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790784576.658143:0:15018:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790784576.658144:0:15018:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790784576.658145:0:15018:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790784576.658146:0:15018:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790784576.658147:0:15018:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790784576.658148:0:15018:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790784576.658149:0:15018:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790784576.658963:0:15018:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1790784576.658986:0:15018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359604352:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790784576.659053:0:15018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784576.659159:0:15018:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905596480 going to sleep for 11 seconds 00000100:00100000:1.0:1790784576.663088:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359604352 00000100:00100000:1.0:1790784576.663105:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359604352 00000100:00100000:1.0:1790784576.663305:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790784576.663316:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+12:15018:x1877773359604352:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790784576.663355:0:14328:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1790784576.663359:0:14328:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1790784576.663362:0:14328:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1790784576.684782:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+12:15018:x1877773359604352:12345-0@lo:253:mount.lustre.0 Request processed in 21459us (25720us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784576.684796:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790784576.684986:0:15018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359604352:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790784576.685001:0:15018:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1790784576.685004:0:15018:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790784576.685006:0:15018:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790784576.685007:0:15018:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790784576.685008:0:15018:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790784576.685009:0:15018:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790784576.685010:0:15018:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790784576.685012:0:15018:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790784576.685014:0:15018:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790784576.685015:0:15018:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790784576.685034:0:15018:0:(tgt_mount.c:101:server_register_mount()) register mount ffff945935d6d800 from lustre-OST0000 10000000:01000000:1.0:1790784576.685056:0:15018:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1790784576.685060:0:15018:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1790784576.685065:0:15018:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff94590574cd40 local copy 00010000:00010000:1.0:1790784576.685076:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945802d2fe00/0x2c3a1e2a079d4691 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4698 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784576.686263:0:15018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359604480:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790784576.686318:0:15018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784576.686361:0:15018:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459055969c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790784576.686426:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359604480 00000100:00100000:2.0:1790784576.686434:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359604480 00000100:00100000:2.0:1790784576.686496:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790784576.686506:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+12:15018:x1877773359604480:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790784576.686685:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+12:15018:x1877773359604480:12345-0@lo:501:mount.lustre.0 Request processed in 179us (365us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790784576.686692:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790784576.686741:0:15018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359604480:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1790784576.686757:0:15018:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1790784576.686928:0:15018:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.132@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1790784576.686936:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945802d2fe00/0x2c3a1e2a079d4691 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4698 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784576.686958:0:15018:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff945802d2fe00/0x2c3a1e2a079d4691 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4698 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790784576.686985:0:15018:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff945935d6d800 10000000:01000000:0.0:1790784576.686989:0:15018:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790784576.686994:0:15018:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff94590574cd40 10000000:01000000:0.0:1790784576.686996:0:15018:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1790784576.686999:0:15018:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff94590574cd40 from 1 10000000:01000000:0.0:1790784576.687002:0:15018:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1790784576.688284:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff94593c1b1000/0x2c3a1e2a079d47a9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784576.688298:0:15018:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff94593c1b1000/0x2c3a1e2a079d47a9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784576.688310:0:15018:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff94593c1b1000/0x2c3a1e2a079d47a9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784576.688333:0:15018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359604608:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790784576.689749:0:15018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784576.689798:0:15018:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459055969c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790784576.690190:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359604608 00000100:00100000:1.0:1790784576.690271:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359604608 00000100:00100000:1.0:1790784576.690347:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790784576.690356:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+12:15018:x1877773359604608:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790784576.690414:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784576.690433:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945900031c00/0x2c3a1e2a079d47b0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d47a9 expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784576.690459:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945900031c00/0x2c3a1e2a079d47b0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d47a9 expref: 13 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784576.690470:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945900031c00/0x2c3a1e2a079d47b0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d47a9 expref: 13 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784576.690479:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945900031c00, rc 0) 00000100:00100000:1.0:1790784576.690532:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+13:15018:x1877773359604608:12345-0@lo:101:mount.lustre.0 Request processed in 177us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784576.690539:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790784576.691348:0:15018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359604608:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790784576.691367:0:15018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff94593c1b1000/0x2c3a1e2a079d47a9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d47b0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784576.691408:0:15018:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff94593c1b1000/0x2c3a1e2a079d47a9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d47b0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790784576.691446:0:15018:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1790784576.691458:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff94593c1b1000/0x2c3a1e2a079d47a9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d47b0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784576.691466:0:15018:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff94593c1b1000/0x2c3a1e2a079d47a9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d47b0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790784576.691474:0:15018:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1790784576.691480:0:15018:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790784576.691486:0:15018:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1790784576.691488:0:15018:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1790784576.691515:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff94593c1b1e00/0x2c3a1e2a079d47b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784576.691524:0:15018:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff94593c1b1e00/0x2c3a1e2a079d47b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784576.691532:0:15018:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff94593c1b1e00/0x2c3a1e2a079d47b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784576.691564:0:15018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359604736:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790784576.693151:0:15018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784576.693332:0:15018:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459055969c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790784576.693733:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359604736 00000100:00100000:1.0:1790784576.693743:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359604736 00000100:00100000:1.0:1790784576.693801:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790784576.693811:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+13:15018:x1877773359604736:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790784576.693826:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784576.693842:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945900030400/0x2c3a1e2a079d47be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d47b7 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784576.693870:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945900030400/0x2c3a1e2a079d47be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d47b7 expref: 14 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784576.693881:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945900030400/0x2c3a1e2a079d47be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d47b7 expref: 14 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784576.693888:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945900030400, rc 0) 00000100:00100000:1.0:1790784576.694037:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+14:15018:x1877773359604736:12345-0@lo:101:mount.lustre.0 Request processed in 227us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784576.694045:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790784576.700468:0:15018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359604736:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790784576.700497:0:15018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff94593c1b1e00/0x2c3a1e2a079d47b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d47be expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784576.700509:0:15018:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff94593c1b1e00/0x2c3a1e2a079d47b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d47be expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790784576.702012:0:15018:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1790784576.705942:0:15018:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790784576.711281:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1790784576.711371:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1790784576.711427:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1790784576.711478:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1790784576.711518:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1790784576.711568:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1790784576.711666:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1790784576.711698:0:15018:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1790784576.711796:0:15018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359604864:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790784576.711877:0:15018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784576.711912:0:15018:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910ff8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790784576.712795:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359604864 00000100:00100000:0.0:1790784576.712804:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359604864 00000100:00100000:0.0:1790784576.712861:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790784576.712871:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+14:15018:x1877773359604864:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790784576.713753:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+14:15018:x1877773359604864:12345-0@lo:501:mount.lustre.0 Request processed in 881us (1872us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784576.713769:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790784576.714899:0:15018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359604864:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790784576.714959:0:15018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359604992:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790784576.715029:0:15018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784576.715059:0:15018:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910ff8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790784576.716733:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359604992 00000100:00100000:0.0:1790784576.716744:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359604992 00000100:00100000:0.0:1790784576.716812:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790784576.716822:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+14:15018:x1877773359604992:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790784576.718417:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+14:15018:x1877773359604992:12345-0@lo:503:mount.lustre.0 Request processed in 1590us (3393us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784576.718430:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790784576.719350:0:15018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359604992:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790784576.719997:0:15018:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790784576.720077:0:15018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359605120:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790784576.720158:0:15018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784576.720192:0:15018:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910ff8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790784576.724340:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359605120 00000100:00100000:0.0:1790784576.724355:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359605120 00000100:00100000:0.0:1790784576.724463:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790784576.724473:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+14:15018:x1877773359605120:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790784576.724802:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+14:15018:x1877773359605120:12345-0@lo:502:mount.lustre.0 Request processed in 330us (4643us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784576.724810:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790784576.725722:0:15018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359605120:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790784576.726003:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1790784576.726063:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1790784576.726119:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1790784576.726169:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1790784576.726355:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1790784576.726422:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1790784576.726472:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1790784576.726511:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1790784576.726651:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1790784576.726711:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1790784576.726750:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1790784576.726798:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1790784576.726845:0:15018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359605248:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790784576.726927:0:15018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784576.726968:0:15018:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459050c0780 going to sleep for 11 seconds 00000100:00100000:2.0:1790784576.727219:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359605248 00000100:00100000:2.0:1790784576.727226:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359605248 00000100:00100000:2.0:1790784576.727269:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790784576.727278:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+14:15018:x1877773359605248:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790784576.727479:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+14:15018:x1877773359605248:12345-0@lo:502:mount.lustre.0 Request processed in 201us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784576.727487:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790784576.728416:0:15018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359605248:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790784576.728530:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1790784576.728555:0:15018:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1790784576.737403:0:15032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790784576.737416:0:15032:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1790784576.737424:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790784576.737426:0:15032:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1790784576.737434:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790784576.737451:0:15032:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff94590574b380) 00000020:00000080:0.0:1790784576.737472:0:15032:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1790784576.737477:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790784576.737561:0:15032:0:(tgt_mount.c:153:server_get_mount()) get mount ffff945935d6d800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1790784576.737570:0:15032:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790784576.737576:0:15032:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2c3a1e2a079d47cc 00010000:00010000:1.0:1790784576.745569:0:15032:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1790784576.746196:0:15032:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1790784576.750725:0:15032:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1790784576.758083:0:15032:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1790784576.758096:0:15032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790784576.758103:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784576.758105:0:15032:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1790784576.758109:0:15032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790784576.758111:0:15032:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1790784576.758120:0:15032:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790784576.758122:0:15032:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790784576.758123:0:15032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790784576.758126:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784576.758128:0:15032:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790784576.758130:0:15032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790784576.758133:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784576.758134:0:15032:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790784576.758137:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790784576.758139:0:15032:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790784576.758141:0:15032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790784576.758143:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784576.758144:0:15032:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790784576.758146:0:15032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790784576.758148:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784576.758150:0:15032:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790784576.758152:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1790784576.758291:0:15032:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790784576.758296:0:15032:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784576.758297:0:15032:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790784576.758300:0:15032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1790784576.758569:0:15018:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1790784576.758594:0:15018:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1790784576.758623:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff94593c1b1e00/0x2c3a1e2a079d47b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d47be expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784576.758635:0:15018:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff94593c1b1e00/0x2c3a1e2a079d47b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d47be expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790784576.758644:0:15018:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff945935d6d800 from 1 10000000:01000000:3.0:1790784576.758647:0:15018:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790784576.758680:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945802d2e400/0x2c3a1e2a079d47d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784576.758689:0:15018:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff945802d2e400/0x2c3a1e2a079d47d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784576.758699:0:15018:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff945802d2e400/0x2c3a1e2a079d47d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784576.758721:0:15018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359605376:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790784576.758782:0:15018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784576.758827:0:15018:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459050c0780 going to sleep for 11 seconds 00000100:00100000:2.0:1790784576.759041:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359605376 00000100:00100000:2.0:1790784576.759048:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359605376 00000100:00100000:2.0:1790784576.759106:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790784576.759114:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+14:15018:x1877773359605376:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790784576.759126:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784576.759138:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94593fe74800/0x2c3a1e2a079d47da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d47d3 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784576.759159:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94593fe74800/0x2c3a1e2a079d47da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d47d3 expref: 15 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784576.759169:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94593fe74800/0x2c3a1e2a079d47da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d47d3 expref: 15 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784576.759187:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74800, rc 0) 00000100:00100000:2.0:1790784576.759357:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+15:15018:x1877773359605376:12345-0@lo:101:mount.lustre.0 Request processed in 243us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784576.759365:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790784576.759481:0:15018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359605376:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790784576.759496:0:15018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff945802d2e400/0x2c3a1e2a079d47d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d47da expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784576.759505:0:15018:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff945802d2e400/0x2c3a1e2a079d47d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d47da expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790784576.759996:0:15018:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1790784576.765947:0:15018:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790784576.766955:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1790784576.767006:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1790784576.768554:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1790784576.768573:0:15018:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1790784576.769668:0:15018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359605504:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790784576.769734:0:15018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784576.769770:0:15018:0:(client.c:2716:ptlrpc_set_wait()) set ffff945935eae6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790784576.771332:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359605504 00000100:00100000:3.0:1790784576.771345:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359605504 00000100:00100000:3.0:1790784576.771409:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790784576.771419:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+15:15018:x1877773359605504:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790784576.771698:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+15:15018:x1877773359605504:12345-0@lo:501:mount.lustre.0 Request processed in 280us (1962us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784576.771711:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790784576.771765:0:15018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359605504:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790784576.771809:0:15018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d346a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359605632:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790784576.771850:0:15018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784576.771878:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359605632 00000100:00100000:3.0:1790784576.771882:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359605632 00000100:00100000:3.0:1790784576.771903:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790784576.771910:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+15:15018:x1877773359605632:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790784576.772052:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+15:15018:x1877773359605632:12345-0@lo:503:mount.lustre.0 Request processed in 142us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784576.772059:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790784576.772116:0:15018:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459050c0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790784576.772130:0:15018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d346a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359605632:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790784576.772992:0:15018:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790784576.773080:0:15018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d346a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359605760:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790784576.773124:0:15018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784576.773156:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359605760 00000100:00100000:3.0:1790784576.773161:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359605760 00000100:00100000:3.0:1790784576.773187:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790784576.773193:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+15:15018:x1877773359605760:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790784576.776807:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+15:15018:x1877773359605760:12345-0@lo:502:mount.lustre.0 Request processed in 3609us (3678us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784576.776818:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790784576.776890:0:15018:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459050c0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790784576.776917:0:15018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d346a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359605760:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790784576.777852:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1790784576.777913:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1790784576.777961:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1790784576.778001:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1790784576.778053:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1790784576.790876:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1790784576.790936:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1790784576.790971:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1790784576.791017:0:15018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d346a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359605888:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790784576.791514:0:15018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784576.791599:0:15018:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459050c0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790784576.791703:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359605888 00000100:00100000:0.0:1790784576.791710:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359605888 00000100:00100000:0.0:1790784576.791796:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790784576.791805:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+15:15018:x1877773359605888:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790784576.792000:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+15:15018:x1877773359605888:12345-0@lo:502:mount.lustre.0 Request processed in 195us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784576.792007:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790784576.792109:0:15018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d346a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359605888:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790784576.792239:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1790784576.792250:0:15018:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1790784576.793445:0:15036:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790784576.793455:0:15036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790784576.793458:0:15036:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790784576.793474:0:15036:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff945935d6d800 00000020:00000080:1.0:1790784576.793476:0:15036:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790784576.793483:0:15036:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790784576.793485:0:15036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790784576.793487:0:15036:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790784576.793489:0:15036:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790784576.793491:0:15036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790784576.793492:0:15036:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790784576.793495:0:15036:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff945935d6d800 00000020:00000080:1.0:1790784576.793497:0:15036:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790784576.793547:0:15036:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790784576.793551:0:15036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790784576.793553:0:15036:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790784576.793555:0:15036:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790784576.793558:0:15036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790784576.793559:0:15036:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790784576.793563:0:15036:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff945935d6d800 00000020:00000080:1.0:1790784576.793565:0:15036:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790784576.793600:0:15036:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790784576.793604:0:15036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790784576.793605:0:15036:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1790784576.799282:0:15036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1790784576.802814:0:15018:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1790784576.802861:0:15018:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790784576.802885:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945802d2e400/0x2c3a1e2a079d47d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d47da expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784576.802899:0:15018:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff945802d2e400/0x2c3a1e2a079d47d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d47da expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790784576.802948:0:15018:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790784576.802951:0:15018:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff945935d6d800 10000000:01000000:0.0:1790784576.802954:0:15018:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff945935d6d800 10000000:01000000:0.0:1790784576.802958:0:15018:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790784576.802963:0:15018:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff945935d6d800 from 1 10000000:01000000:0.0:1790784576.802966:0:15018:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790784576.802998:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff94593c1b0c00/0x2c3a1e2a079d47e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784576.803007:0:15018:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff94593c1b0c00/0x2c3a1e2a079d47e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784576.803025:0:15018:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff94593c1b0c00/0x2c3a1e2a079d47e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784576.803050:0:15018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359606016:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790784576.803136:0:15018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784576.803172:0:15018:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459055963c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790784576.805468:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359606016 00000100:00100000:2.0:1790784576.805484:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359606016 00000100:00100000:2.0:1790784576.805585:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790784576.805596:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+15:15018:x1877773359606016:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790784576.805613:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784576.805630:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94593fe75800/0x2c3a1e2a079d47e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d47e1 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784576.805657:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94593fe75800/0x2c3a1e2a079d47e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d47e1 expref: 16 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784576.805668:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94593fe75800/0x2c3a1e2a079d47e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d47e1 expref: 16 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784576.805675:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe75800, rc 0) 00000100:00100000:2.0:1790784576.806768:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+16:15018:x1877773359606016:12345-0@lo:101:mount.lustre.0 Request processed in 1092us (3550us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784576.806779:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790784576.807741:0:15018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359606016:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790784576.807766:0:15018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff94593c1b0c00/0x2c3a1e2a079d47e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d47e8 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784576.807778:0:15018:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff94593c1b0c00/0x2c3a1e2a079d47e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d47e8 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790784576.811591:0:15018:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1790784576.814554:0:15018:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790784576.814960:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1790784576.815010:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1790784576.815048:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1790784576.815122:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1790784576.815160:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1790784576.827134:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1790784576.827456:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1790784576.827495:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1790784576.827546:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1790784576.828124:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1790784576.829284:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1790784576.829361:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1790784576.829414:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1790784576.829448:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1790784576.829502:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1790784576.829543:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1790784576.829573:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1790784576.829617:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1790784576.829652:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1790784576.829704:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1790784576.829748:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1790784576.829782:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1790784576.829813:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1790784576.829861:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1790784576.829898:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1790784576.829935:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1790784576.829986:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1790784576.832822:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1790784576.832902:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1790784576.832909:0:15018:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1790784576.833813:0:15018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359606144:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790784576.833877:0:15018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784576.833910:0:15018:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905e830c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790784576.833992:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359606144 00000100:00100000:0.0:1790784576.834001:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359606144 00000100:00100000:0.0:1790784576.834052:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790784576.834062:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+16:15018:x1877773359606144:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790784576.834361:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+16:15018:x1877773359606144:12345-0@lo:501:mount.lustre.0 Request processed in 300us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784576.834370:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790784576.834498:0:15018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359606144:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790784576.834534:0:15018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359606272:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790784576.834570:0:15018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784576.834593:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359606272 00000100:00100000:2.0:1790784576.834596:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359606272 00000100:00100000:2.0:1790784576.834626:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790784576.834632:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+16:15018:x1877773359606272:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790784576.834761:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+16:15018:x1877773359606272:12345-0@lo:503:mount.lustre.0 Request processed in 128us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784576.834769:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790784576.834805:0:15018:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905e830c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790784576.834817:0:15018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359606272:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790784576.835615:0:15018:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790784576.835695:0:15018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359606400:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790784576.835737:0:15018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784576.835770:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359606400 00000100:00100000:2.0:1790784576.835775:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359606400 00000100:00100000:2.0:1790784576.835802:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790784576.835809:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+16:15018:x1877773359606400:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790784576.836221:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+16:15018:x1877773359606400:12345-0@lo:502:mount.lustre.0 Request processed in 398us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784576.836230:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790784576.836268:0:15018:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905e830c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790784576.836282:0:15018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359606400:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790784576.836517:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1790784576.836568:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1790784576.836596:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1790784576.836635:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1790784576.836664:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1790784576.836700:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1790784576.836729:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1790784576.836758:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1790784576.836799:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1790784576.836831:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1790784576.836871:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1790784576.836914:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1790784576.836946:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1790784576.836974:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1790784576.837226:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1790784576.837260:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1790784576.837287:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1790784576.837341:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1790784576.837371:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1790784576.837425:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1790784576.837471:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1790784576.837508:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1790784576.837549:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1790784576.837618:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1790784576.837669:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1790784576.837715:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1790784576.837768:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1790784576.837817:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1790784576.837886:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1790784576.837952:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1790784576.838085:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1790784576.838122:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1790784576.838153:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1790784576.838234:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1790784576.838284:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1790784576.838340:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1790784576.838395:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1790784576.838430:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1790784576.838475:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1790784576.838511:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1790784576.838556:0:15018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359606528:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790784576.838619:0:15018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784576.838664:0:15018:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905e830c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790784576.838686:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359606528 00000100:00100000:0.0:1790784576.838694:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359606528 00000100:00100000:0.0:1790784576.838737:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790784576.838745:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+16:15018:x1877773359606528:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790784576.838927:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+16:15018:x1877773359606528:12345-0@lo:502:mount.lustre.0 Request processed in 182us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784576.838939:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790784576.840434:0:15018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359606528:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790784576.840554:0:15018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1790784576.840570:0:15018:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1790784576.846896:0:15041:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1790784576.846924:0:15041:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff945926dc0000) 00000020:00000080:2.0:1790784576.846944:0:15041:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1790784576.847295:0:15041:0:(tgt_mount.c:153:server_get_mount()) get mount ffff945935d6d800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790784576.847300:0:15041:0:(tgt_mount.c:187:server_put_mount()) put mount ffff945935d6d800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1790784576.847303:0:15041:0:(obd_mount.c:710:lustre_put_lsi()) put ffff945935d6d800 3 00010000:00080000:2.0:1790784576.847332:0:15041:0:(ldlm_lib.c:102:import_set_conn()) imp ffff945926dbd800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.132@tcp at head 00010000:00010000:2.0:1790784576.849805:0:15041:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1790784576.850098:0:15041:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1790784576.850199:0:15041:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790784576.850224:0:15041:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2c3a1e2a079d47f6 00000100:00080000:2.0:1790784576.850236:0:15041:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790784576.850248:0:15041:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff945926dbd800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:2.0:1790784576.850286:0:15041:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94592d9cfb80 x1877773359606656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790784576.850335:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3278:1877773359606656:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790784576.850419:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784576.850507:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359606656 00000100:00100000:2.0:1790784576.850515:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359606656 00000100:00100000:2.0:1790784576.850548:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790784576.850556:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3278:x1877773359606656:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790784576.850578:0:14336:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 410 last 0 00000020:00000080:2.0:1790784576.850615:0:14336:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2c3a1e2a079d47fd 00000004:00100000:2.0:1790784576.850634:0:14336:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790784576.850663:0:14336:0:(import.c:65:import_set_state_nolock()) ffff9459051b5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790784576.850716:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1877773359606656:12345-0@lo:38:llog_process_th.0 Request processed in 158us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784576.850724:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1790784576.850745:0:15041:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00080000:0.0:1790784576.850747:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94592d9cfb80 x1877773359606656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790784586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784576.850759:0:3278:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790784576.850768:0:3278:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1790784576.850775:0:3278:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790784576.850779:0:3278:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790784576.850781:0:3278:0:(import.c:65:import_set_state_nolock()) ffff945926dbd800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790784576.850787:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3278:1877773359606656:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1790784576.850809:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790784576.850813:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790784576.850816:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790784576.850819:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790784576.850882:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1877773359606784:0@lo:400:kworker.0 00000100:00100000:2.0:1790784576.850922:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1790784576.852351:0:15041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1790784576.852468:0:15018:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1790784576.852498:0:15018:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790784576.852512:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff94593c1b0c00/0x2c3a1e2a079d47e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d47e8 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784576.852524:0:15018:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff94593c1b0c00/0x2c3a1e2a079d47e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d47e8 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790784576.852570:0:15018:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790784576.852573:0:15018:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790784576.852574:0:15018:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790784576.852576:0:15018:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790784576.852578:0:15018:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790784576.852579:0:15018:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790784576.852581:0:15018:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790784576.852583:0:15018:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790784576.852584:0:15018:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790784576.852587:0:15018:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1790784576.852590:0:15018:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790784576.852592:0:15018:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790784576.852593:0:15018:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790784576.852594:0:15018:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790784576.852595:0:15018:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790784576.852600:0:15018:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790784576.852601:0:15018:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790784576.852602:0:15018:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790784576.852603:0:15018:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790784576.852623:0:15018:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790784576.852639:0:15018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359606912:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790784576.852688:0:15018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784576.852716:0:15018:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905e83b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790784576.853702:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359606784 00000100:00100000:0.0:1790784576.853711:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359606784 00000100:00100000:0.0:1790784576.853763:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790784576.853772:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1877773359606784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784576.853842:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1877773359606784:12345-0@lo:400:kworker.0 Request processed in 71us (2919us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784576.853849:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790784576.853872:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359606912 00000100:00100000:0.0:1790784576.853875:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359606912 00000100:00100000:0.0:1790784576.853904:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790784576.853910:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+16:15018:x1877773359606912:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790784576.853937:0:14329:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790784576.853948:0:14329:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1790784576.854633:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94590569ed80 x1877773359606784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790784592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784576.854648:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1877773359606784:0@lo:400:kworker.0 20000000:01000000:3.0:1790784576.901745:0:14329:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790784576.901763:0:14329:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1790784576.903098:0:14351:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790784576.903107:0:14351:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790784576.903128:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff945900031800/0x2c3a1e2a079d4804 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784576.903146:0:14351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff945802d2ea00/0x2c3a1e2a079d4771 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d476a expref: 16 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784576.903155:0:14351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff945900031800/0x2c3a1e2a079d4804 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784576.903195:0:14351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff945802d2ea00/0x2c3a1e2a079d4771 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d476a expref: 16 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784576.903235:0:14351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff945802d2ea00/0x2c3a1e2a079d4771 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d476a expref: 16 pid: 14329 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784576.903256:0:14351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa3800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14351:1877773359607040:0@lo:104: 00000100:00100000:1.0:1790784576.903322:0:14351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784576.903595:0:14351:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459012ed480 going to sleep for 11 seconds 00000100:00100000:2.0:1790784576.906658:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359607040 00000100:00100000:2.0:1790784576.906675:0:14318:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359607040 00000100:00100000:2.0:1790784576.906726:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790784576.906735:0:14318:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592daa0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+3:14351:x1877773359607040:12345-0@lo:104: 00010000:00010000:2.0:1790784576.906753:0:14318:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff94593fe74400/0x2c3a1e2a079d476a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d4771 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784576.906840:0:14318:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790784576.906846:0:14318:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592daa0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+3:14351:x1877773359607040:12345-0@lo:104: Request processed in 113us (3524us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784576.906853:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1790784576.906921:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790784576.906928:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff94593fe74400/0x2c3a1e2a079d476a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d4771 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784576.906936:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74400 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:3.0:1790784576.906941:0:14324:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff94593fe74400/0x2c3a1e2a079d476a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d4771 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784576.906951:0:14324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff94593fe74400/0x2c3a1e2a079d476a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d4771 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790784576.906958:0:14324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff94593fe74400/0x2c3a1e2a079d476a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d4771 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790784576.906977:0:14324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790784576.907020:0:14324:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff94593fe74400/0x2c3a1e2a079d476a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d4771 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784576.907026:0:14324:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790784576.907046:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff94593fe74400/0x2c3a1e2a079d476a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d4771 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784576.907053:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff94593fe74400/0x2c3a1e2a079d476a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d4771 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784576.907081:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784576.907083:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784576.907084:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784576.907092:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790784576.907105:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3279:1877773359607168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790784576.907144:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784576.908983:0:14351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa3800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14351:1877773359607040:0@lo:104: 00010000:00010000:1.0:1790784576.909009:0:14351:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff945900031800/0x2c3a1e2a079d4804 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784576.909054:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359607168 00000100:00100000:1.0:1790784576.909060:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359607168 00010000:00010000:1.0:1790784576.909099:0:14322:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff945802d2ea00/0x2c3a1e2a079d4771 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d476a expref: 17 pid: 14329 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784576.909136:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790784576.909145:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d347800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+17:3279:x1877773359607168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790784576.909159:0:14322:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784576.909164:0:14322:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff945802d2ea00/0x2c3a1e2a079d4771 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d476a expref: 17 pid: 14329 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784576.909175:0:14322:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff945802d2ea00/0x2c3a1e2a079d4771 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d476a expref: 17 pid: 14329 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784576.909191:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945802d2ea00/0x2c3a1e2a079d4771 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d476a expref: 17 pid: 14329 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784576.909204:0:14322:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff945900031800/0x2c3a1e2a079d4804 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784576.909236:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945900031800/0x2c3a1e2a079d4804 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790784576.909259:0:14322:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006153122s 00010000:00010000:1.0:1790784576.909264:0:14322:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff945900031800/0x2c3a1e2a079d4804 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784576.909271:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff945900031800/0x2c3a1e2a079d4804 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784576.909277:0:14322:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff945900031800/0x2c3a1e2a079d4804 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784576.909284:0:14322:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff945900031800/0x2c3a1e2a079d4804 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784576.909289:0:14322:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900031800 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:1.0:1790784576.909294:0:14322:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff945900031800/0x2c3a1e2a079d4804 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784576.909302:0:14322:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff945900031800/0x2c3a1e2a079d4804 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784576.909323:0:14322:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff945900031800/0x2c3a1e2a079d4804 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784576.909341:0:14322:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790784576.909421:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d347800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+16:3279:x1877773359607168:12345-0@lo:103:ldlm_bl.0 Request processed in 277us (2275us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784576.909429:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790784576.909469:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3279:1877773359607168:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790784576.910067:0:14351:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff945900031800/0x2c3a1e2a079d4804 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784576.910077:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff945900031800/0x2c3a1e2a079d4804 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784576.910083:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945900031800/0x2c3a1e2a079d4804 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784576.920361:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+15:15018:x1877773359606912:12345-0@lo:253:mount.lustre.0 Request processed in 66441us (67662us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784576.920418:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790784576.920648:0:15018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15018:1877773359606912:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790784576.920663:0:15018:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790784576.920666:0:15018:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790784576.920668:0:15018:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790784576.920670:0:15018:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790784576.920671:0:15018:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790784576.920672:0:15018:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790784576.920673:0:15018:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790784576.920674:0:15018:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790784576.920676:0:15018:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790784576.920678:0:15018:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790784576.920690:0:15018:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790784576.925044:0:15018:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1790784576.925226:0:15018:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790784576.925676:0:15018:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1790784576.925835:0:15018:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790784576.925978:0:15018:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1790784576.926179:0:15018:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1790784576.927172:0:15018:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1790784576.989513:0:15018:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1790784576.989521:0:15018:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1790784576.989624:0:15018:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790784576.989687:0:15018:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.132@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790784576.989700:0:15018:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1790784576.989725:0:15018:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1790784577.678622:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784578.684407:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790784578.938585:0:14333:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790784578.938595:0:14333:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94593c4ab000 from 7 10000000:01000000:2.0:1790784578.938601:0:14333:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790784578.938668:0:14333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff94593fe74e00/0x2c3a1e2a079d480b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784578.938697:0:14333:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff94593fe74e00/0x2c3a1e2a079d480b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784578.938712:0:14333:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff94593fe74e00/0x2c3a1e2a079d480b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784578.938748:0:14333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359607296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790784578.938856:0:14333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784578.938951:0:14333:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459102b5900 going to sleep for 11 seconds 00000100:00100000:0.0:1790784578.939086:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359607296 00000100:00100000:0.0:1790784578.939096:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359607296 00000100:00100000:0.0:1790784578.939164:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790784578.939176:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+15:14333:x1877773359607296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790784578.939193:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784578.939222:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94593c1b1800/0x2c3a1e2a079d4812 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d480b expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784578.939251:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94593c1b1800/0x2c3a1e2a079d4812 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d480b expref: 16 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784578.939263:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94593c1b1800/0x2c3a1e2a079d4812 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d480b expref: 16 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784578.939273:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b1800, rc 0) 00000100:00100000:0.0:1790784578.939319:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+16:14333:x1877773359607296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784578.939326:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790784578.939573:0:14333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359607296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790784578.939593:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff94593fe74e00/0x2c3a1e2a079d480b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4812 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784578.939601:0:14333:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff94593fe74e00/0x2c3a1e2a079d480b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d4812 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784578.939680:0:14333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d347480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359607424:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790784578.939719:0:14333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784578.939753:0:14333:0:(client.c:2716:ptlrpc_set_wait()) set ffff94590aec0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790784578.939802:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359607424 00000100:00100000:1.0:1790784578.939807:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359607424 00000100:00100000:1.0:1790784578.939843:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790784578.939851:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+16:14333:x1877773359607424:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790784578.939868:0:14329:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790784578.939890:0:14329:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790784578.939893:0:14329:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1790784578.939987:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+16:14333:x1877773359607424:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 136us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784578.939996:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790784578.940174:0:14333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d347480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359607424:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790784578.940256:0:14333:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790784578.940265:0:14333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff94593fe74e00/0x2c3a1e2a079d480b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4812 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784578.940273:0:14333:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff94593fe74e00/0x2c3a1e2a079d480b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4812 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784579.711260:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784580.730808:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784581.757821:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790784582.076347:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790784582.076356:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790784582.076359:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790784582.076362:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790784582.076449:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1877773359607680:0@lo:400:kworker.0 00000100:00100000:3.0:1790784582.076549:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784582.076638:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790784582.076645:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d347480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3282:1877773359607552:0@lo:400:kworker.0 00000100:00100000:3.0:1790784582.076680:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784582.076716:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359607808:0@lo:400:kworker.0 00000100:00100000:3.0:1790784582.076746:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784582.076901:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359607680 00000100:00100000:2.0:1790784582.076911:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359607680 00000100:00100000:2.0:1790784582.076968:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359607808 00000100:00100000:2.0:1790784582.076972:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359607808 00000100:00100000:2.0:1790784582.077010:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790784582.077021:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1877773359607680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784582.077086:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1877773359607680:12345-0@lo:400:kworker.0 Request processed in 67us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784582.077094:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790784582.077114:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790784582.077120:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359607808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784582.077152:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359607808:12345-0@lo:400:kworker.0 Request processed in 32us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784582.077158:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790784582.077179:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359607552 00000100:00100000:2.0:1790784582.077193:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359607552 00000100:00100000:2.0:1790784582.077220:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790784582.077227:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+16:3282:x1877773359607552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784582.077259:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+16:3282:x1877773359607552:12345-0@lo:400:kworker.0 Request processed in 32us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784582.077265:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790784582.077316:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d347480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3282:1877773359607552:0@lo:400:kworker.0 00010000:00080000:2.0:1790784582.077332:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94592d345180 x1877773359607680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790784598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790784582.077344:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1877773359607680:0@lo:400:kworker.0 00000100:00080000:3.0:1790784582.077613:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790784582.077641:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94592d346680 x1877773359607808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790784598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784582.077652:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359607808:0@lo:400:kworker.0 00010000:00010000:3.0:1790784582.784174:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784583.802700:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790784584.381350:0:14368:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790784584.827187:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790784584.941361:0:15386:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg632-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1790784585.852706:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784586.875631:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784587.067943:0:3278:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790784572/real 1790784572] req@ffff94590569ce00 x1877773359603584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790784587 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784587.067983:0:3278:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94590569ce00 x1877773359603584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790784587 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784587.068010:0:3278:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790784572/real 1790784572] req@ffff94590569f800 x1877773359603712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790784587 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784587.068023:0:3278:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94590569f800 x1877773359603712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790784587 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790784587.068044:0:3278:0:(import.c:65:import_set_state_nolock()) ffff9459103c5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790784587.068067:0:3278:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790784587.068071:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1877773359603584:0@lo:8:kworker.0 00000100:00080000:0.0:1790784587.068078:0:3278:0:(import.c:65:import_set_state_nolock()) ffff94591a8a3000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790784587.068083:0:3278:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790784587.068086:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1877773359603712:0@lo:8:kworker.0 00000100:00080000:3.0:1790784587.068218:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790784587.068223:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790784587.068227:0:36:0:(import.c:65:import_set_state_nolock()) ffff9459103c5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790784587.068232:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 406 00000100:00080000:3.0:1790784587.068238:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790784587.068250:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9459103c5800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:3.0:1790784587.068272:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94592d346300 x1877773359608064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790784587.068288:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790784587.068291:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790784587.068292:0:36:0:(import.c:65:import_set_state_nolock()) ffff94591a8a3000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790784587.068296:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 406 00000100:00080000:3.0:1790784587.068298:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790784587.068311:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94591a8a3000 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:3.0:1790784587.068324:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94592d344e00 x1877773359608192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790784587.068419:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1877773359608320:0@lo:400:kworker.0 00000100:00100000:3.0:1790784587.068503:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784587.068565:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790784587.068571:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359608448:0@lo:400:kworker.0 00000100:00100000:3.0:1790784587.068598:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784587.068642:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359608320 00000100:00100000:3.0:1790784587.068651:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359608320 00000100:00100000:3.0:1790784587.068699:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359608448 00000100:00100000:3.0:1790784587.068703:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359608448 00000100:00100000:3.0:1790784587.068731:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790784587.068741:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1877773359608320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784587.068795:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1877773359608320:12345-0@lo:400:kworker.0 Request processed in 56us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784587.068803:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790784587.068822:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790784587.068828:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1877773359608448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784587.068855:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1877773359608448:12345-0@lo:400:kworker.0 Request processed in 28us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784587.068861:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1790784587.068886:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790784587.068897:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1877773359608064:0@lo:8:kworker.0 00000100:00100000:3.0:1790784587.068929:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784587.068953:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d344e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1877773359608192:0@lo:8:kworker.0 00000100:00100000:3.0:1790784587.069008:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1790784587.069054:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94592d345c00 x1877773359608448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790784603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784587.069066:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359608448:0@lo:400:kworker.0 00010000:00080000:3.0:1790784587.069078:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94592d345880 x1877773359608320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790784603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784587.069086:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1877773359608320:0@lo:400:kworker.0 00000100:00100000:0.0:1790784587.069336:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790784587.069349:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3279:1877773359607936:0@lo:400:kworker.0 00000100:00100000:0.0:1790784587.069421:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784587.069453:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359607936 00000100:00100000:0.0:1790784587.069458:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359607936 00000100:00100000:0.0:1790784587.069493:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790784587.069500:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+16:3279:x1877773359607936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784587.069540:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+16:3279:x1877773359607936:12345-0@lo:400:kworker.0 Request processed in 40us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784587.069547:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790784587.069589:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3279:1877773359607936:0@lo:400:kworker.0 00000100:00100000:2.0:1790784587.069851:0:15020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359608064 00000100:00100000:2.0:1790784587.069856:0:15020:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359608064 00000100:00100000:2.0:1790784587.069880:0:15020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359608192 00000100:00100000:2.0:1790784587.069894:0:15020:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359608192 00000100:00100000:2.0:1790784587.069919:0:15020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790784587.069924:0:15020:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3278:x1877773359608064:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790784587.069954:0:15020:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 421 last 0 00000020:00000080:2.0:1790784587.069993:0:15020:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2c3a1e2a079d4819 00002000:00100000:2.0:1790784587.070009:0:15020:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff945926db8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1790784587.070013:0:15020:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1790784587.070017:0:15020:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790784587.070715:0:15020:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790784587.070750:0:15020:0:(import.c:65:import_set_state_nolock()) ffff945926dbc000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790784587.070831:0:15020:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3278:x1877773359608064:12345-0@lo:8:kworker.0 Request processed in 905us (1900us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784587.070839:0:15020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790784587.070861:0:15020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790784587.070866:0:15020:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d345500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3278:x1877773359608192:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1790784587.070880:0:15020:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790784587.071641:0:15020:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d345500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3278:x1877773359608192:12345-0@lo:8:kworker.0 Request processed in 768us (2628us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790784587.071651:0:15020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790784587.072612:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94592d346300 x1877773359608064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790784607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784587.072628:0:3278:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790784587.072640:0:3278:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1790784587.072650:0:3278:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790784587.072657:0:3278:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1790784587.072660:0:3278:0:(import.c:65:import_set_state_nolock()) ffff9459103c5800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790784587.072685:0:3278:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790784587.072922:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1877773359608064:0@lo:8:kworker.0 00000100:00080000:3.0:1790784587.072941:0:3278:0:(import.c:65:import_set_state_nolock()) ffff94591a8a3000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790784587.072947:0:3278:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790784587.072950:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d344e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1877773359608192:0@lo:8:kworker.0 00000004:00080000:1.0:1790784587.073232:0:14358:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:1.0:1790784587.073259:0:14358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14358:1877773359608704:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1790784587.073332:0:14358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784587.073363:0:14358:0:(client.c:2716:ptlrpc_set_wait()) set ffff945907d92540 going to sleep for 11 seconds 00000100:00100000:1.0:1790784587.073444:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359608704 00000100:00100000:1.0:1790784587.073451:0:15022:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359608704 00000100:00100000:1.0:1790784587.073627:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790784587.073645:0:15022:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592daa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14358:x1877773359608704:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1790784587.074048:0:14357:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790784587.074346:0:14357:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 421223969709ns, next at 0ns, rc = 0 00000100:00100000:3.0:1790784587.074617:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359608576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790784587.074678:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1790784587.086137:0:15022:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1790784587.086152:0:15022:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1790784587.086174:0:15022:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00080000:0.0:1790784587.088475:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790784587.112673:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359608576 00000100:00100000:0.0:1790784587.112706:0:15023:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359608576 00000100:00100000:0.0:1790784587.112791:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790784587.112807:0:15023:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d344e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1877773359608576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790784587.112862:0:15023:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790784587.114853:0:15023:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d344e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1877773359608576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2041us (40163us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784587.114871:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790784587.115362:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94592daa3800 x1877773359608576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784603 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784587.115983:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359608576:0@lo:13:osp-pre-0-0.0 00002000:00010000:0.0:1790784587.118077:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790784587.118094:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062a962f1/0x2c3a1e2a079d4820 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.118115:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=421s v=(0 0) 00010000:00010000:0.0:1790784587.118121:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790784587.118129:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062a962f1/0x2c3a1e2a079d4820 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.118152:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062a962f1/0x2c3a1e2a079d4820 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.119059:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062a962f1/0x2c3a1e2a079d4820 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.119070:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062a962f1/0x2c3a1e2a079d4820 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.119106:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790784587.119309:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790784587.119318:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062a962f1/0x2c3a1e2a079d4820 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784587.119328:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b0000 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:3.0:1790784587.119334:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062a962f1/0x2c3a1e2a079d4820 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784587.119345:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062a962f1/0x2c3a1e2a079d4820 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784587.119392:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062a962f1/0x2c3a1e2a079d4820 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784587.119401:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062a962f1/0x2c3a1e2a079d4820 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784587.120260:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784587.120264:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784587.120266:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790784587.126473:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790784587.126487:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d4827 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.126517:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1790784587.126530:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784587.126539:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d4827 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.126564:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d4827 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.126576:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d4827 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.126585:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d4827 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.126605:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790784587.126621:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790784587.126627:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d4827 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.126641:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030c00 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:1.0:1790784587.126646:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d4827 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.126655:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d4827 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.126681:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d4827 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.126700:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d4827 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.127093:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784587.127254:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784587.127257:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790784587.129268:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790784587.129288:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d482e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.129310:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1790784587.129349:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784587.129357:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d482e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.130467:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d482e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.130628:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d482e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.130638:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d482e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.130773:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790784587.130806:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790784587.131176:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d482e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.131186:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030000 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:1.0:1790784587.131191:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d482e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.131201:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d482e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.131221:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d482e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.131229:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d482e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.131316:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784587.131322:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784587.131328:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790784587.133321:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790784587.133332:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000084f445a/0x2c3a1e2a079d4835 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.133349:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1790784587.133354:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784587.133361:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000084f445a/0x2c3a1e2a079d4835 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.133418:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000084f445a/0x2c3a1e2a079d4835 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.133429:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000084f445a/0x2c3a1e2a079d4835 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.133436:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000084f445a/0x2c3a1e2a079d4835 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.133454:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790784587.133617:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790784587.133624:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000084f445a/0x2c3a1e2a079d4835 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784587.133633:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900031800 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:3.0:1790784587.133639:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000084f445a/0x2c3a1e2a079d4835 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784587.133660:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000084f445a/0x2c3a1e2a079d4835 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784587.133687:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000084f445a/0x2c3a1e2a079d4835 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784587.133696:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000084f445a/0x2c3a1e2a079d4835 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784587.133726:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784587.133729:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784587.133731:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790784587.136333:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790784587.136346:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d483c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.136371:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1790784587.136409:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784587.136418:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d483c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.136432:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d483c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.136443:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d483c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.136466:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d483c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.136492:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790784587.136522:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790784587.136528:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d483c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.136536:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030000 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:1.0:1790784587.136541:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d483c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.136551:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d483c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.136570:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d483c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.136577:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060693e62/0x2c3a1e2a079d483c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.136617:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784587.136621:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784587.136623:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790784587.137553:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790784587.137570:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d4843 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.137582:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1790784587.137586:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784587.137591:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d4843 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.137602:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d4843 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.137610:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d4843 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.137617:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d4843 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.137638:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790784587.139315:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790784587.139335:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d4843 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784587.139353:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030c00 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:3.0:1790784587.139361:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d4843 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784587.139396:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d4843 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784587.139438:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d4843 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784587.139462:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000182618ad/0x2c3a1e2a079d4843 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790784587.139489:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790784587.139630:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784587.139634:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784587.139636:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784587.139913:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9850aec/0x2c3a1e2a079d484a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.139932:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1790784587.139936:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784587.139942:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9850aec/0x2c3a1e2a079d484a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.139955:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9850aec/0x2c3a1e2a079d484a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.139975:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9850aec/0x2c3a1e2a079d484a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.139983:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9850aec/0x2c3a1e2a079d484a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.140009:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790784587.140905:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790784587.140914:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016042809/0x2c3a1e2a079d4851 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.140925:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1790784587.140929:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784587.140934:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016042809/0x2c3a1e2a079d4851 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.140945:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016042809/0x2c3a1e2a079d4851 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.140954:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016042809/0x2c3a1e2a079d4851 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.140961:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016042809/0x2c3a1e2a079d4851 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.140992:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790784587.141253:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790784587.141275:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9850aec/0x2c3a1e2a079d484a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.141288:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030e00 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:0.0:1790784587.141294:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9850aec/0x2c3a1e2a079d484a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.141307:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9850aec/0x2c3a1e2a079d484a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.141328:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9850aec/0x2c3a1e2a079d484a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.141336:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9850aec/0x2c3a1e2a079d484a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.141361:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790784587.141365:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016042809/0x2c3a1e2a079d4851 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.141372:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955e200 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:0.0:1790784587.141403:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016042809/0x2c3a1e2a079d4851 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.141412:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016042809/0x2c3a1e2a079d4851 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.141441:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016042809/0x2c3a1e2a079d4851 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.141450:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016042809/0x2c3a1e2a079d4851 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.141470:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784587.141472:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784587.141474:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784587.141601:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790784587.142780:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790784587.142793:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b9f9804/0x2c3a1e2a079d4858 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.142808:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1790784587.142814:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784587.142982:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b9f9804/0x2c3a1e2a079d4858 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.142999:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b9f9804/0x2c3a1e2a079d4858 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.143013:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b9f9804/0x2c3a1e2a079d4858 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.143022:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b9f9804/0x2c3a1e2a079d4858 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.143059:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790784587.143083:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790784587.143090:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b9f9804/0x2c3a1e2a079d4858 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.143099:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955e400 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:1.0:1790784587.143113:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b9f9804/0x2c3a1e2a079d4858 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.143125:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b9f9804/0x2c3a1e2a079d4858 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.143143:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b9f9804/0x2c3a1e2a079d4858 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.143151:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b9f9804/0x2c3a1e2a079d4858 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.143199:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784587.143204:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784587.143211:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790784587.144481:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790784587.144493:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000abba5fd/0x2c3a1e2a079d485f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.144753:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1790784587.144760:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784587.144769:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000abba5fd/0x2c3a1e2a079d485f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.144788:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000abba5fd/0x2c3a1e2a079d485f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.144798:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000abba5fd/0x2c3a1e2a079d485f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.144816:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000abba5fd/0x2c3a1e2a079d485f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.145129:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790784587.145150:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790784587.145165:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000abba5fd/0x2c3a1e2a079d485f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.145173:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955f200 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:1.0:1790784587.145178:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000abba5fd/0x2c3a1e2a079d485f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.145188:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000abba5fd/0x2c3a1e2a079d485f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.145204:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000abba5fd/0x2c3a1e2a079d485f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.145211:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000abba5fd/0x2c3a1e2a079d485f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.145235:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784587.145242:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784587.145244:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790784587.146096:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790784587.146116:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f858ec8d/0x2c3a1e2a079d4866 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.146128:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1790784587.146133:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784587.146138:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f858ec8d/0x2c3a1e2a079d4866 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.146149:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f858ec8d/0x2c3a1e2a079d4866 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.146171:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f858ec8d/0x2c3a1e2a079d4866 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.146179:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f858ec8d/0x2c3a1e2a079d4866 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.146204:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790784587.146219:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790784587.146225:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f858ec8d/0x2c3a1e2a079d4866 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.146233:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955ee00 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:1.0:1790784587.146239:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f858ec8d/0x2c3a1e2a079d4866 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.146249:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f858ec8d/0x2c3a1e2a079d4866 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.146273:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f858ec8d/0x2c3a1e2a079d4866 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.146282:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f858ec8d/0x2c3a1e2a079d4866 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.146307:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784587.146308:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784587.146310:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790784587.147290:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790784587.147300:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9096c0a/0x2c3a1e2a079d486d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.147311:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1790784587.147314:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784587.147320:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9096c0a/0x2c3a1e2a079d486d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.147330:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9096c0a/0x2c3a1e2a079d486d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.147338:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9096c0a/0x2c3a1e2a079d486d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.147345:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9096c0a/0x2c3a1e2a079d486d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.147415:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790784587.148017:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790784587.148025:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097399248/0x2c3a1e2a079d4874 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.148036:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1790784587.148039:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784587.148043:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097399248/0x2c3a1e2a079d4874 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.148054:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097399248/0x2c3a1e2a079d4874 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.148063:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097399248/0x2c3a1e2a079d4874 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.148070:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097399248/0x2c3a1e2a079d4874 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.148090:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790784587.148106:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790784587.148111:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9096c0a/0x2c3a1e2a079d486d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.148119:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955fc00 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:1.0:1790784587.148129:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9096c0a/0x2c3a1e2a079d486d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.148139:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9096c0a/0x2c3a1e2a079d486d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.148164:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9096c0a/0x2c3a1e2a079d486d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.148173:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9096c0a/0x2c3a1e2a079d486d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.148194:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790784587.148198:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097399248/0x2c3a1e2a079d4874 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.148204:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955f600 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:1.0:1790784587.148208:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097399248/0x2c3a1e2a079d4874 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.148214:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097399248/0x2c3a1e2a079d4874 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.148224:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097399248/0x2c3a1e2a079d4874 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.148231:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097399248/0x2c3a1e2a079d4874 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.148251:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784587.148253:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784587.148255:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784587.148642:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790784587.151805:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790784587.151832:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2b72e10/0x2c3a1e2a079d487b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.151850:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1790784587.151855:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784587.151862:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2b72e10/0x2c3a1e2a079d487b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.151877:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2b72e10/0x2c3a1e2a079d487b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.151887:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2b72e10/0x2c3a1e2a079d487b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.151895:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2b72e10/0x2c3a1e2a079d487b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.151920:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790784587.151939:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790784587.151944:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2b72e10/0x2c3a1e2a079d487b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.151965:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955ea00 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:1.0:1790784587.151970:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2b72e10/0x2c3a1e2a079d487b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.151980:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2b72e10/0x2c3a1e2a079d487b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.151995:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2b72e10/0x2c3a1e2a079d487b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.152003:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2b72e10/0x2c3a1e2a079d487b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.152028:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784587.152030:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784587.152032:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790784587.153664:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790784587.153739:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6a9ef52/0x2c3a1e2a079d4882 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.153755:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1790784587.153759:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784587.153766:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6a9ef52/0x2c3a1e2a079d4882 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.153781:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6a9ef52/0x2c3a1e2a079d4882 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.153801:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6a9ef52/0x2c3a1e2a079d4882 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.153809:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6a9ef52/0x2c3a1e2a079d4882 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.154612:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790784587.155525:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790784587.155543:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6a9ef52/0x2c3a1e2a079d4882 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784587.155559:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955ec00 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:3.0:1790784587.155565:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6a9ef52/0x2c3a1e2a079d4882 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784587.155579:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6a9ef52/0x2c3a1e2a079d4882 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784587.155605:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6a9ef52/0x2c3a1e2a079d4882 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784587.155613:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6a9ef52/0x2c3a1e2a079d4882 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784587.155652:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784587.155669:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784587.155671:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790784587.158690:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790784587.158707:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5447cfb/0x2c3a1e2a079d4889 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.158727:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1790784587.158731:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784587.158738:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5447cfb/0x2c3a1e2a079d4889 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.158755:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5447cfb/0x2c3a1e2a079d4889 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.158766:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5447cfb/0x2c3a1e2a079d4889 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.158774:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5447cfb/0x2c3a1e2a079d4889 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.159620:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790784587.159648:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790784587.159659:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5447cfb/0x2c3a1e2a079d4889 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.159671:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955f000 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:1.0:1790784587.159676:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5447cfb/0x2c3a1e2a079d4889 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.159686:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5447cfb/0x2c3a1e2a079d4889 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.159704:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5447cfb/0x2c3a1e2a079d4889 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.159712:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5447cfb/0x2c3a1e2a079d4889 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.159739:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784587.159742:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784587.159744:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790784587.162142:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790784587.162164:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000912a179e/0x2c3a1e2a079d4890 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.162182:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1790784587.163366:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784587.163400:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000912a179e/0x2c3a1e2a079d4890 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.163420:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000912a179e/0x2c3a1e2a079d4890 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.163432:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000912a179e/0x2c3a1e2a079d4890 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.163440:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000912a179e/0x2c3a1e2a079d4890 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.163470:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790784587.163525:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790784587.163538:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000912a179e/0x2c3a1e2a079d4890 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.163552:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955e800 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:0.0:1790784587.163557:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000912a179e/0x2c3a1e2a079d4890 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.163571:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000912a179e/0x2c3a1e2a079d4890 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.163596:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000912a179e/0x2c3a1e2a079d4890 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.163604:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000912a179e/0x2c3a1e2a079d4890 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.163652:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784587.163654:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784587.163656:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790784587.165340:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790784587.165351:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097399248/0x2c3a1e2a079d4897 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.165366:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1790784587.165370:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784587.165408:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097399248/0x2c3a1e2a079d4897 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.165422:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097399248/0x2c3a1e2a079d4897 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.165432:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097399248/0x2c3a1e2a079d4897 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.165447:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097399248/0x2c3a1e2a079d4897 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.165468:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790784587.165486:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790784587.165491:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097399248/0x2c3a1e2a079d4897 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.165499:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955f600 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:1.0:1790784587.167618:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097399248/0x2c3a1e2a079d4897 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.167641:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097399248/0x2c3a1e2a079d4897 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.167664:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097399248/0x2c3a1e2a079d4897 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.167673:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097399248/0x2c3a1e2a079d4897 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.167763:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784587.167768:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784587.167771:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790784587.173090:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790784587.173117:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9096c0a/0x2c3a1e2a079d489e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.173137:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1790784587.173142:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784587.173149:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9096c0a/0x2c3a1e2a079d489e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.173175:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9096c0a/0x2c3a1e2a079d489e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.173186:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9096c0a/0x2c3a1e2a079d489e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.173195:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9096c0a/0x2c3a1e2a079d489e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.173300:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790784587.174092:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790784587.174108:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9096c0a/0x2c3a1e2a079d489e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.174124:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955fc00 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:0.0:1790784587.174130:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9096c0a/0x2c3a1e2a079d489e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.174142:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9096c0a/0x2c3a1e2a079d489e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.174181:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9096c0a/0x2c3a1e2a079d489e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.174190:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9096c0a/0x2c3a1e2a079d489e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.174226:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784587.174228:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784587.174230:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790784587.175001:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790784587.175013:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f858ec8d/0x2c3a1e2a079d48a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.175027:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1790784587.175031:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784587.175037:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f858ec8d/0x2c3a1e2a079d48a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.175051:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f858ec8d/0x2c3a1e2a079d48a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.175067:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f858ec8d/0x2c3a1e2a079d48a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.175074:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f858ec8d/0x2c3a1e2a079d48a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.175096:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790784587.175113:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790784587.175118:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f858ec8d/0x2c3a1e2a079d48a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.175126:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955ee00 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:1.0:1790784587.175131:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f858ec8d/0x2c3a1e2a079d48a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.175140:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f858ec8d/0x2c3a1e2a079d48a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.175163:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f858ec8d/0x2c3a1e2a079d48a5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.175170:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f858ec8d/0x2c3a1e2a079d48a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.175192:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784587.175199:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784587.175201:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790784587.177226:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790784587.177239:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000abba5fd/0x2c3a1e2a079d48ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.177255:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1790784587.177259:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784587.177265:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000abba5fd/0x2c3a1e2a079d48ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.177279:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000abba5fd/0x2c3a1e2a079d48ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.177289:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000abba5fd/0x2c3a1e2a079d48ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.177297:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000abba5fd/0x2c3a1e2a079d48ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.177323:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790784587.179216:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790784587.179226:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b9f9804/0x2c3a1e2a079d48b3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.179241:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1790784587.179245:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784587.179251:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b9f9804/0x2c3a1e2a079d48b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.179271:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b9f9804/0x2c3a1e2a079d48b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.179926:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b9f9804/0x2c3a1e2a079d48b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.179938:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b9f9804/0x2c3a1e2a079d48b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.179964:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790784587.179981:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790784587.179988:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000abba5fd/0x2c3a1e2a079d48ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.179996:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955f200 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:1.0:1790784587.180000:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000abba5fd/0x2c3a1e2a079d48ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.180010:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000abba5fd/0x2c3a1e2a079d48ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.180027:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000abba5fd/0x2c3a1e2a079d48ac lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.180035:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000abba5fd/0x2c3a1e2a079d48ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.180070:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790784587.180074:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b9f9804/0x2c3a1e2a079d48b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.180080:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955e400 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:1.0:1790784587.180083:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b9f9804/0x2c3a1e2a079d48b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.180092:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b9f9804/0x2c3a1e2a079d48b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.180103:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b9f9804/0x2c3a1e2a079d48b3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.180110:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b9f9804/0x2c3a1e2a079d48b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.180126:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784587.180127:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784587.180129:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784587.180313:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790784587.184398:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790784587.184411:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5447cfb/0x2c3a1e2a079d48ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.184429:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1790784587.184434:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784587.184447:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5447cfb/0x2c3a1e2a079d48ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.184462:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5447cfb/0x2c3a1e2a079d48ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.184473:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5447cfb/0x2c3a1e2a079d48ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.184482:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5447cfb/0x2c3a1e2a079d48ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.185609:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790784587.185637:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790784587.185645:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5447cfb/0x2c3a1e2a079d48ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.185658:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955f000 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:1.0:1790784587.185663:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5447cfb/0x2c3a1e2a079d48ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.185673:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5447cfb/0x2c3a1e2a079d48ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.185770:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5447cfb/0x2c3a1e2a079d48ba lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.185800:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5447cfb/0x2c3a1e2a079d48ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.185912:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784587.185914:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784587.185917:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790784587.187465:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790784587.187476:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2b72e10/0x2c3a1e2a079d48c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.187492:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1790784587.187496:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784587.188468:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2b72e10/0x2c3a1e2a079d48c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.188492:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2b72e10/0x2c3a1e2a079d48c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.188568:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2b72e10/0x2c3a1e2a079d48c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.188578:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2b72e10/0x2c3a1e2a079d48c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.188606:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790784587.190391:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790784587.190408:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2b72e10/0x2c3a1e2a079d48c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.190441:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955ea00 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:0.0:1790784587.190447:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2b72e10/0x2c3a1e2a079d48c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.190460:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2b72e10/0x2c3a1e2a079d48c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.190487:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2b72e10/0x2c3a1e2a079d48c1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.190495:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2b72e10/0x2c3a1e2a079d48c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.190524:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784587.190526:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784587.190528:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790784587.193053:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790784587.193071:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090e867f4/0x2c3a1e2a079d48c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.193088:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1790784587.193093:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784587.193100:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090e867f4/0x2c3a1e2a079d48c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.193113:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090e867f4/0x2c3a1e2a079d48c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.193123:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090e867f4/0x2c3a1e2a079d48c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.193131:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090e867f4/0x2c3a1e2a079d48c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.193168:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790784587.193344:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790784587.193361:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090e867f4/0x2c3a1e2a079d48c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.193397:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955e000 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:0.0:1790784587.193404:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090e867f4/0x2c3a1e2a079d48c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.193418:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090e867f4/0x2c3a1e2a079d48c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.193459:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090e867f4/0x2c3a1e2a079d48c8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.193467:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090e867f4/0x2c3a1e2a079d48c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.193505:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784587.193508:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784587.193510:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790784587.215657:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790784587.215670:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089e04fac/0x2c3a1e2a079d48cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.215686:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1790784587.215690:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784587.215696:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089e04fac/0x2c3a1e2a079d48cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.215709:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089e04fac/0x2c3a1e2a079d48cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.215728:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089e04fac/0x2c3a1e2a079d48cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.215736:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089e04fac/0x2c3a1e2a079d48cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.215761:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790784587.217404:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790784587.217420:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089e04fac/0x2c3a1e2a079d48cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.217437:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955f800 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:0.0:1790784587.217444:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089e04fac/0x2c3a1e2a079d48cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.217456:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089e04fac/0x2c3a1e2a079d48cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.217483:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089e04fac/0x2c3a1e2a079d48cf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.217492:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089e04fac/0x2c3a1e2a079d48cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.217539:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784587.217541:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784587.217543:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790784587.217960:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790784587.217974:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da56b57f/0x2c3a1e2a079d48d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.217991:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1790784587.218072:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784587.218080:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da56b57f/0x2c3a1e2a079d48d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.218095:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da56b57f/0x2c3a1e2a079d48d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.218106:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da56b57f/0x2c3a1e2a079d48d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.218114:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da56b57f/0x2c3a1e2a079d48d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.218148:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790784587.220565:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790784587.220577:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000912a179e/0x2c3a1e2a079d48dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.220592:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1790784587.220596:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784587.220603:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000912a179e/0x2c3a1e2a079d48dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.220616:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000912a179e/0x2c3a1e2a079d48dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.220627:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000912a179e/0x2c3a1e2a079d48dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784587.220636:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000912a179e/0x2c3a1e2a079d48dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.221193:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790784587.221207:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da56b57f/0x2c3a1e2a079d48d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.221222:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955f400 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:0.0:1790784587.221229:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da56b57f/0x2c3a1e2a079d48d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.221241:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da56b57f/0x2c3a1e2a079d48d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.221263:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da56b57f/0x2c3a1e2a079d48d6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.221270:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da56b57f/0x2c3a1e2a079d48d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.221301:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784587.221303:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784587.221305:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784587.221438:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790784587.221464:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790784587.221472:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000912a179e/0x2c3a1e2a079d48dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.221499:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955e800 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:0.0:1790784587.221503:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000912a179e/0x2c3a1e2a079d48dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.221522:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000912a179e/0x2c3a1e2a079d48dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.221535:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000912a179e/0x2c3a1e2a079d48dd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.221543:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000912a179e/0x2c3a1e2a079d48dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784587.221562:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784587.221564:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784587.221566:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1790784587.221913:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:1.0:1790784587.222456:0:15022:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:1.0:1790784587.222633:0:15022:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592daa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14358:x1877773359608704:12345-0@lo:5:osp-pre-0-0.0 Request processed in 148991us (149296us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784587.222646:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790784587.222809:0:14358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14358:1877773359608704:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1790784587.222893:0:14358:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1790784587.222939:0:14358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14358:1877773359608832:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1790784587.222976:0:14358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784587.223117:0:14358:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905ea99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790784587.223141:0:15020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359608832 00000100:00100000:1.0:1790784587.223148:0:15020:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359608832 00000100:00100000:1.0:1790784587.223284:0:15020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790784587.223295:0:15020:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592daa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14358:x1877773359608832:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1790784587.223333:0:15020:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1790784587.299859:0:15020:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592daa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14358:x1877773359608832:12345-0@lo:5:osp-pre-0-0.0 Request processed in 76553us (76870us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1790784587.299902:0:15020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790784587.300361:0:14358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14358:1877773359608832:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1790784587.300403:0:14358:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000001:00100000:0.0:1790784587.367669:0:6693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1790784587.898607:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784588.925001:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784589.946623:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784590.970738:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784591.994549:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790784592.291831:0:15738:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790784592.291835:0:15738:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1790784592.292305:0:15738:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff945926dbf800 00000020:01000004:2.0:1790784592.292321:0:15738:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1790784592.292334:0:15738:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1790784592.292347:0:15738:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff945926dc4d40) 00000020:00000080:2.0:1790784592.292360:0:15738:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1790784592.309093:0:15738:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790784592.309547:0:15738:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1790784592.310330:0:15738:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790784592.310659:0:15738:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1790784592.310856:0:15738:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1790784592.311290:0:15738:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 189: rc = 0 00100000:10000000:2.0:1790784592.311479:0:15738:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 189: rc = 0 00100000:10000000:2.0:1790784592.311630:0:15738:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 189: rc = 0 00100000:10000000:2.0:1790784592.312106:0:15738:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 582: rc = 0 00100000:10000000:2.0:1790784592.312529:0:15738:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 582: rc = 0 00100000:10000000:2.0:1790784592.312777:0:15738:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 582: rc = 0 00100000:10000000:2.0:1790784592.313013:0:15738:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 582: rc = 0 00100000:10000000:2.0:1790784592.313340:0:15738:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 582: rc = 0 00100000:10000000:2.0:1790784592.313679:0:15738:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 582: rc = 0 00000020:00000080:2.0:1790784592.314325:0:15738:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1790784592.314337:0:15738:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790784592.314346:0:15738:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2c3a1e2a079d48eb 00000020:01000004:2.0:1790784592.314354:0:15738:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1790784592.314475:0:15738:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.132@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790784592.314478:0:15738:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790784592.314484:0:15738:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1790784592.314506:0:15738:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1790784592.314511:0:15738:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.132@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000100:00080000:3.0:1790784592.314522:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790784592.314528:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790784592.314532:0:36:0:(import.c:65:import_set_state_nolock()) ffff94591a8a3000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790784592.314539:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 421 00000100:00080000:3.0:1790784592.314544:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1790784592.314554:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94591a8a3000 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:3.0:1790784592.314579:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94592d345c00 x1877773359609216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790784592.314638:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359609472:0@lo:400:kworker.0 00000100:00100000:0.0:1790784592.314698:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3280:1877773359608960:0@lo:400:kworker.0 00000100:00100000:3.0:1790784592.314705:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784592.321294:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784592.321394:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359609600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790784592.321434:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784592.321461:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359609600 00000100:00100000:0.0:1790784592.321468:0:15023:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359609600 00000100:00100000:0.0:1790784592.321522:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790784592.321531:0:15023:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1877773359609600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790784592.321561:0:15023:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790784592.321599:0:15023:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1877773359609600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784592.321606:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1790784592.321625:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790784592.321660:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359609600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790784592.323004:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359608960 00000100:00100000:0.0:1790784592.323013:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359608960 00000100:00100000:0.0:1790784592.323050:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790784592.323058:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+16:3280:x1877773359608960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784592.323114:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+16:3280:x1877773359608960:12345-0@lo:400:kworker.0 Request processed in 57us (1824us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784592.323120:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790784592.323190:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3280:1877773359608960:0@lo:400:kworker.0 00000100:00100000:0.0:1790784592.323942:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359609472 00000100:00100000:0.0:1790784592.323948:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359609472 00000100:00100000:0.0:1790784592.324048:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790784592.324055:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359609472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784592.324101:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359609472:12345-0@lo:400:kworker.0 Request processed in 47us (9397us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784592.324118:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790784592.324205:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1877773359609216:0@lo:8:kworker.0 00000100:00100000:0.0:1790784592.324240:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784592.324275:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d346a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1877773359609344:0@lo:400:kworker.0 00000100:00100000:0.0:1790784592.324300:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784592.324322:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790784592.324329:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359609088:0@lo:400:kworker.0 00000100:00100000:0.0:1790784592.324349:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790784592.324389:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790784592.324399:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359609344 00000100:00100000:0.0:1790784592.324403:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359609344 00000100:00100000:0.0:1790784592.324425:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790784592.324431:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1877773359609344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784592.324467:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1877773359609344:12345-0@lo:400:kworker.0 Request processed in 36us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784592.324473:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790784592.324491:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359609216 00000100:00100000:0.0:1790784592.324494:0:15021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359609216 00000100:00100000:0.0:1790784592.324506:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359609088 00000100:00100000:0.0:1790784592.324508:0:15021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359609088 00000100:00100000:0.0:1790784592.324523:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790784592.324529:0:15021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1877773359609088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784592.324556:0:15021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1877773359609088:12345-0@lo:400:kworker.0 Request processed in 27us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784592.324562:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790784592.324573:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790784592.324583:0:15021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3278:x1877773359609216:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1790784592.324599:0:15021:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1790784592.325291:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94592d344380 x1877773359609472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790784608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790784592.325305:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359609472:0@lo:400:kworker.0 00000040:01000000:2.0:1790784592.331057:0:15738:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.132@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790784592.331095:0:15738:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.132@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1790784592.331099:0:15738:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790784592.331101:0:15738:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790784592.331103:0:15738:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790784592.331104:0:15738:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790784592.331106:0:15738:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790784592.331107:0:15738:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790784592.331108:0:15738:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790784592.331110:0:15738:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790784592.331112:0:15738:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790784592.331115:0:15738:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1790784592.331117:0:15738:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790784592.331119:0:15738:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790784592.331120:0:15738:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790784592.331121:0:15738:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790784592.331122:0:15738:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790784592.331124:0:15738:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790784592.331125:0:15738:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790784592.331126:0:15738:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790784592.331136:0:15738:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790784592.333823:0:15738:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790784592.333851:0:15738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359609728:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790784592.333931:0:15738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784592.334042:0:15738:0:(client.c:2716:ptlrpc_set_wait()) set ffff945907d92d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790784592.337489:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359609728 00000100:00100000:2.0:1790784592.337500:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359609728 00000100:00100000:1.0:1790784592.338732:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359609088:0@lo:400:kworker.0 00000100:00100000:2.0:1790784592.338749:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1790784592.338759:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94592d346a00 x1877773359609344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790784608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790784592.338763:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+16:15738:x1877773359609728:12345-0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790784592.338777:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d346a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1877773359609344:0@lo:400:kworker.0 20000000:01000000:2.0:1790784592.338803:0:14328:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1790784592.338807:0:14328:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1790784592.338811:0:14328:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1790784592.349899:0:15021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3278:x1877773359609216:12345-0@lo:8:kworker.0 Request processed in 25308us (25651us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790784592.349914:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1790784592.349978:0:3278:0:(import.c:65:import_set_state_nolock()) ffff94591a8a3000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790784592.349983:0:3278:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790784592.349988:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1877773359609216:0@lo:8:kworker.0 00000100:00100000:0.0:1790784592.381529:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+16:15738:x1877773359609728:12345-0@lo:253:mount.lustre.0 Request processed in 42762us (47589us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784592.381545:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790784592.381653:0:15738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359609728:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790784592.381667:0:15738:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790784592.381671:0:15738:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790784592.381683:0:15738:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790784592.381685:0:15738:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790784592.381686:0:15738:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790784592.381688:0:15738:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790784592.381689:0:15738:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790784592.381690:0:15738:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790784592.381692:0:15738:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790784592.381693:0:15738:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790784592.381710:0:15738:0:(tgt_mount.c:101:server_register_mount()) register mount ffff945926dbf800 from lustre-OST0001 10000000:01000000:2.0:1790784592.381744:0:15738:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1790784592.381747:0:15738:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1790784592.381754:0:15738:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff94590574cd40 local copy 00010000:00010000:2.0:1790784592.381763:0:15738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945802d2fe00/0x2c3a1e2a079d4691 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4698 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784592.382021:0:15738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359609856:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790784592.382051:0:15738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784592.382075:0:15738:0:(client.c:2716:ptlrpc_set_wait()) set ffff94590ad12d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790784592.382147:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359609856 00000100:00100000:0.0:1790784592.382153:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359609856 00000100:00100000:0.0:1790784592.382200:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790784592.382207:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+16:15738:x1877773359609856:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790784592.382564:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+16:15738:x1877773359609856:12345-0@lo:501:mount.lustre.0 Request processed in 356us (511us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790784592.382572:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790784592.382697:0:15738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359609856:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1790784592.382708:0:15738:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1790784592.382826:0:15738:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.132@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1790784592.382833:0:15738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945802d2fe00/0x2c3a1e2a079d4691 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4698 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784592.382843:0:15738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff945802d2fe00/0x2c3a1e2a079d4691 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4698 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790784592.382863:0:15738:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff945926dbf800 10000000:01000000:2.0:1790784592.382867:0:15738:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790784592.382871:0:15738:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1790784592.382874:0:15738:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790784592.382882:0:15738:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1790784592.382885:0:15738:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1790784592.382904:0:15738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff94593fe75200/0x2c3a1e2a079d48f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784592.382912:0:15738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff94593fe75200/0x2c3a1e2a079d48f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784592.382921:0:15738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff94593fe75200/0x2c3a1e2a079d48f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784592.382933:0:15738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359609984:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790784592.382958:0:15738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784592.382985:0:15738:0:(client.c:2716:ptlrpc_set_wait()) set ffff94590ad12d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790784592.383034:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359609984 00000100:00100000:0.0:1790784592.383038:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359609984 00000100:00100000:0.0:1790784592.383068:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790784592.383074:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+16:15738:x1877773359609984:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790784592.383083:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784592.383094:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94593c1b1c00/0x2c3a1e2a079d48f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d48f2 expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784592.383123:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94593c1b1c00/0x2c3a1e2a079d48f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d48f2 expref: 17 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784592.383145:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94593c1b1c00/0x2c3a1e2a079d48f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d48f2 expref: 17 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784592.383153:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b1c00, rc 0) 00000100:00100000:0.0:1790784592.383283:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+17:15738:x1877773359609984:12345-0@lo:101:mount.lustre.0 Request processed in 208us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784592.383289:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790784592.383359:0:15738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359609984:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790784592.383466:0:15738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff94593fe75200/0x2c3a1e2a079d48f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d48f9 expref: -99 pid: 15738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784592.383474:0:15738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff94593fe75200/0x2c3a1e2a079d48f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d48f9 expref: -99 pid: 15738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790784592.384055:0:15738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1790784592.385636:0:15738:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790784592.385885:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1790784592.385930:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1790784592.385978:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1790784592.386028:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1790784592.386064:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1790784592.386094:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1790784592.386177:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1790784592.386195:0:15738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1790784592.386276:0:15738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359610112:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790784592.386335:0:15738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784592.386478:0:15738:0:(client.c:2716:ptlrpc_set_wait()) set ffff945902ac29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790784592.386555:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359610112 00000100:00100000:1.0:1790784592.386561:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359610112 00000100:00100000:1.0:1790784592.386610:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790784592.386620:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+17:15738:x1877773359610112:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790784592.387019:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+17:15738:x1877773359610112:12345-0@lo:501:mount.lustre.0 Request processed in 399us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784592.387027:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790784592.387312:0:15738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359610112:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790784592.387347:0:15738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359610240:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790784592.387430:0:15738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784592.387467:0:15738:0:(client.c:2716:ptlrpc_set_wait()) set ffff945902ac29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790784592.387584:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359610240 00000100:00100000:1.0:1790784592.387589:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359610240 00000100:00100000:1.0:1790784592.387630:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790784592.387637:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+17:15738:x1877773359610240:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790784592.387907:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+17:15738:x1877773359610240:12345-0@lo:503:mount.lustre.0 Request processed in 269us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784592.387914:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790784592.388328:0:15738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359610240:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790784592.390681:0:15738:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790784592.390774:0:15738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359610368:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790784592.390851:0:15738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784592.390885:0:15738:0:(client.c:2716:ptlrpc_set_wait()) set ffff945902ac29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790784592.390958:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359610368 00000100:00100000:1.0:1790784592.390965:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359610368 00000100:00100000:1.0:1790784592.391017:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790784592.391027:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fafb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+17:15738:x1877773359610368:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790784592.391268:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fafb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+17:15738:x1877773359610368:12345-0@lo:502:mount.lustre.0 Request processed in 242us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784592.391275:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790784592.391578:0:15738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359610368:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790784592.391804:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1790784592.391851:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1790784592.391886:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1790784592.391930:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1790784592.391979:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1790784592.392013:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1790784592.392061:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1790784592.392097:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1790784592.392159:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1790784592.392202:0:15738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359610496:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790784592.392245:0:15738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784592.392272:0:15738:0:(client.c:2716:ptlrpc_set_wait()) set ffff945902ac29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790784592.392346:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359610496 00000100:00100000:1.0:1790784592.392352:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359610496 00000100:00100000:1.0:1790784592.392420:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790784592.392428:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593faf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+17:15738:x1877773359610496:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790784592.392573:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593faf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+17:15738:x1877773359610496:12345-0@lo:502:mount.lustre.0 Request processed in 146us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784592.392581:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790784592.392748:0:15738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359610496:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790784592.392813:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1790784592.392823:0:15738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1790784592.393591:0:15740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790784592.393600:0:15740:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1790784592.393605:0:15740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790784592.393608:0:15740:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1790784592.393613:0:15740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790784592.393638:0:15740:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff94593cc6cd40) 00000020:00000080:1.0:1790784592.393659:0:15740:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1790784592.393665:0:15740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790784592.393724:0:15740:0:(tgt_mount.c:153:server_get_mount()) get mount ffff945926dbf800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1790784592.393736:0:15740:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790784592.393743:0:15740:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2c3a1e2a079d4907 00010000:00010000:0.0:1790784592.402031:0:15740:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1790784592.402782:0:15740:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:0.0:1790784592.405766:0:15740:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1790784592.409031:0:15740:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1790784592.409043:0:15740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790784592.409049:0:15740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790784592.409051:0:15740:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1790784592.409055:0:15740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790784592.409059:0:15740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790784592.409061:0:15740:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790784592.409064:0:15740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790784592.409066:0:15740:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790784592.409070:0:15740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790784592.409072:0:15740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790784592.409073:0:15740:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1790784592.409076:0:15740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790784592.409078:0:15740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790784592.409079:0:15740:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790784592.409083:0:15740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1790784592.409172:0:15740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790784592.409177:0:15740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790784592.409179:0:15740:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790784592.409183:0:15740:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1790784592.409417:0:15738:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1790784592.409442:0:15738:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1790784592.409465:0:15738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff94593fe75200/0x2c3a1e2a079d48f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d48f9 expref: -99 pid: 15738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784592.409478:0:15738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff94593fe75200/0x2c3a1e2a079d48f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d48f9 expref: -99 pid: 15738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790784592.409487:0:15738:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff945926dbf800 from 1 10000000:01000000:0.0:1790784592.409489:0:15738:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790784592.409524:0:15738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff94593c1b1600/0x2c3a1e2a079d490e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784592.409532:0:15738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff94593c1b1600/0x2c3a1e2a079d490e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784592.409555:0:15738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff94593c1b1600/0x2c3a1e2a079d490e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784592.409579:0:15738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359610624:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790784592.409643:0:15738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784592.409677:0:15738:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905ea9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790784592.409811:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359610624 00000100:00100000:1.0:1790784592.409818:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359610624 00000100:00100000:1.0:1790784592.409866:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790784592.409876:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593faf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+17:15738:x1877773359610624:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790784592.409889:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784592.409902:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94590955ee00/0x2c3a1e2a079d4915 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d490e expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784592.409926:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94590955ee00/0x2c3a1e2a079d4915 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d490e expref: 18 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784592.409950:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94590955ee00/0x2c3a1e2a079d4915 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d490e expref: 18 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784592.409960:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94590955ee00, rc 0) 00000100:00100000:1.0:1790784592.409998:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593faf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+18:15738:x1877773359610624:12345-0@lo:101:mount.lustre.0 Request processed in 124us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784592.410005:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790784592.412282:0:15738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359610624:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790784592.412315:0:15738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff94593c1b1600/0x2c3a1e2a079d490e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4915 expref: -99 pid: 15738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784592.412326:0:15738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff94593c1b1600/0x2c3a1e2a079d490e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d4915 expref: -99 pid: 15738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790784592.412848:0:15738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1790784592.413342:0:15738:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790784592.413623:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1790784592.413675:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1790784592.413737:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1790784592.413745:0:15738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1790784592.413816:0:15738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359610752:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790784592.413878:0:15738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784592.413920:0:15738:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905ea9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790784592.414171:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359610752 00000100:00100000:3.0:1790784592.414179:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359610752 00000100:00100000:3.0:1790784592.414225:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790784592.414235:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fafb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+18:15738:x1877773359610752:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790784592.414461:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fafb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+18:15738:x1877773359610752:12345-0@lo:501:mount.lustre.0 Request processed in 228us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784592.414469:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790784592.419063:0:15738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359610752:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790784592.419122:0:15738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359610880:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790784592.419609:0:15738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784592.419642:0:15738:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905ea9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790784592.419670:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359610880 00000100:00100000:0.0:1790784592.419676:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359610880 00000100:00100000:0.0:1790784592.419718:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790784592.419726:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593fafbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+18:15738:x1877773359610880:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790784592.420025:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593fafbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+18:15738:x1877773359610880:12345-0@lo:503:mount.lustre.0 Request processed in 299us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784592.420032:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790784592.420085:0:15738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359610880:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790784592.421115:0:15738:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790784592.421206:0:15738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359611008:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790784592.421261:0:15738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784592.421303:0:15738:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905ea9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790784592.423053:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359611008 00000100:00100000:2.0:1790784592.423065:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359611008 00000100:00100000:2.0:1790784592.423116:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790784592.423136:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459366fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+18:15738:x1877773359611008:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790784592.423443:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459366fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+18:15738:x1877773359611008:12345-0@lo:502:mount.lustre.0 Request processed in 317us (2180us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784592.423451:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790784592.423672:0:15738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359611008:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790784592.423938:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1790784592.423989:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1790784592.424035:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1790784592.424070:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1790784592.424104:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1790784592.426043:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1790784592.426118:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1790784592.426172:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1790784592.426215:0:15738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359611136:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790784592.426283:0:15738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784592.426315:0:15738:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905ea9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790784592.426333:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359611136 00000100:00100000:0.0:1790784592.426339:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359611136 00000100:00100000:0.0:1790784592.426732:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790784592.426743:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459366fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+18:15738:x1877773359611136:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790784592.426930:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459366fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+18:15738:x1877773359611136:12345-0@lo:502:mount.lustre.0 Request processed in 189us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784592.426938:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790784592.427859:0:15738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359611136:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790784592.427987:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1790784592.428005:0:15738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1790784592.429743:0:15744:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790784592.429753:0:15744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784592.429756:0:15744:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790784592.429761:0:15744:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff945926dbf800 00000020:00000080:2.0:1790784592.429763:0:15744:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790784592.429771:0:15744:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790784592.429773:0:15744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784592.429774:0:15744:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1790784592.429776:0:15744:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790784592.429778:0:15744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784592.429780:0:15744:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790784592.429783:0:15744:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff945926dbf800 00000020:00000080:2.0:1790784592.429785:0:15744:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790784592.429843:0:15744:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790784592.429847:0:15744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784592.429848:0:15744:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1790784592.429850:0:15744:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790784592.429852:0:15744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784592.429854:0:15744:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790784592.429857:0:15744:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff945926dbf800 00000020:00000080:2.0:1790784592.429860:0:15744:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790784592.429905:0:15744:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790784592.429908:0:15744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790784592.429910:0:15744:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1790784592.429913:0:15744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1790784592.435078:0:15738:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1790784592.435119:0:15738:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790784592.435148:0:15738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff94593c1b1600/0x2c3a1e2a079d490e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4915 expref: -99 pid: 15738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784592.435166:0:15738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff94593c1b1600/0x2c3a1e2a079d490e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4915 expref: -99 pid: 15738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790784592.435210:0:15738:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790784592.435213:0:15738:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff945926dbf800 10000000:01000000:3.0:1790784592.435216:0:15738:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff945926dbf800 10000000:01000000:3.0:1790784592.435221:0:15738:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790784592.435225:0:15738:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff945926dbf800 from 1 10000000:01000000:3.0:1790784592.435228:0:15738:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790784592.435261:0:15738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff945802d2f800/0x2c3a1e2a079d491c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784592.435269:0:15738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff945802d2f800/0x2c3a1e2a079d491c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784592.435278:0:15738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff945802d2f800/0x2c3a1e2a079d491c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784592.435301:0:15738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359611264:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790784592.435357:0:15738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784592.435945:0:15738:0:(client.c:2716:ptlrpc_set_wait()) set ffff945907cdc480 going to sleep for 11 seconds 00000100:00100000:0.0:1790784592.436618:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359611264 00000100:00100000:0.0:1790784592.436628:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359611264 00000100:00100000:0.0:1790784592.436678:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790784592.436687:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459366fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+18:15738:x1877773359611264:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790784592.436702:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784592.436718:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94593c1b0000/0x2c3a1e2a079d4923 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d491c expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784592.436746:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94593c1b0000/0x2c3a1e2a079d4923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d491c expref: 19 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784592.436757:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94593c1b0000/0x2c3a1e2a079d4923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d491c expref: 19 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784592.436766:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b0000, rc 0) 00000100:00100000:0.0:1790784592.436818:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459366fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+19:15738:x1877773359611264:12345-0@lo:101:mount.lustre.0 Request processed in 133us (1460us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784592.436825:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790784592.437284:0:15738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359611264:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790784592.437301:0:15738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff945802d2f800/0x2c3a1e2a079d491c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4923 expref: -99 pid: 15738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784592.437321:0:15738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff945802d2f800/0x2c3a1e2a079d491c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d4923 expref: -99 pid: 15738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790784592.437873:0:15738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1790784592.439624:0:15738:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790784592.439903:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1790784592.439948:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1790784592.444346:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1790784592.444441:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1790784592.444480:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1790784592.444528:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1790784592.444564:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1790784592.444600:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1790784592.444650:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1790784592.444684:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1790784592.444717:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1790784592.444766:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1790784592.444801:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1790784592.444836:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1790784592.444885:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1790784592.444923:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1790784592.444957:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1790784592.445007:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1790784592.445040:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1790784592.445068:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1790784592.445112:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1790784592.445161:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1790784592.445193:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1790784592.445236:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1790784592.445271:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1790784592.445301:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1790784592.445355:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1790784592.445411:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1790784592.445445:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1790784592.445933:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1790784592.446505:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1790784592.446546:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1790784592.446578:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1790784592.446628:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1790784592.446660:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1790784592.446705:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1790784592.446737:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1790784592.446832:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1790784592.446842:0:15738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1790784592.446940:0:15738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359611392:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790784592.448320:0:15738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784592.448463:0:15738:0:(client.c:2716:ptlrpc_set_wait()) set ffff945907cdc480 going to sleep for 11 seconds 00000100:00100000:0.0:1790784592.448615:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359611392 00000100:00100000:0.0:1790784592.448624:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359611392 00000100:00100000:0.0:1790784592.448668:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790784592.448678:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459366fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+19:15738:x1877773359611392:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790784592.448922:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459366fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+19:15738:x1877773359611392:12345-0@lo:501:mount.lustre.0 Request processed in 245us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784592.448939:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790784592.455708:0:15738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359611392:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790784592.455766:0:15738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359611520:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790784592.455832:0:15738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784592.455868:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359611520 00000100:00100000:3.0:1790784592.455874:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359611520 00000100:00100000:3.0:1790784592.455918:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790784592.455927:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459366ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+19:15738:x1877773359611520:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790784592.457458:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459366ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+19:15738:x1877773359611520:12345-0@lo:503:mount.lustre.0 Request processed in 1527us (1621us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784592.457470:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790784592.457549:0:15738:0:(client.c:2716:ptlrpc_set_wait()) set ffff945907cdc480 going to sleep for 11 seconds 00000100:00100000:3.0:1790784592.457569:0:15738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359611520:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790784592.458063:0:15738:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790784592.458139:0:15738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359611648:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790784592.459312:0:15738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784592.459354:0:15738:0:(client.c:2716:ptlrpc_set_wait()) set ffff945907cdc480 going to sleep for 11 seconds 00000001:00080000:3.0:1790784592.459785:0:6693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000100:00100000:0.0:1790784592.461525:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359611648 00000100:00100000:0.0:1790784592.461539:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359611648 00000100:00100000:0.0:1790784592.461637:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790784592.461648:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459366fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+19:15738:x1877773359611648:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790784592.461989:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459366fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+19:15738:x1877773359611648:12345-0@lo:502:mount.lustre.0 Request processed in 343us (2679us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784592.461997:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790784592.462194:0:15738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359611648:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790784592.462548:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1790784592.462605:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1790784592.462639:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1790784592.462687:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1790784592.462724:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1790784592.462792:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1790784592.462828:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1790784592.462864:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1790784592.462910:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1790784592.462947:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1790784592.462980:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1790784592.463035:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1790784592.463069:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1790784592.463095:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1790784592.463146:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1790784592.463181:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1790784592.463210:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1790784592.463250:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1790784592.463284:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1790784592.463315:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1790784592.463359:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1790784592.463424:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1790784592.463458:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1790784592.463503:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1790784592.463543:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1790784592.463571:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1790784592.463612:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1790784592.463642:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1790784592.463671:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1790784592.463712:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1790784592.463744:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1790784592.463770:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1790784592.463795:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1790784592.463837:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1790784592.463870:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1790784592.463917:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1790784592.463953:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1790784592.464000:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1790784592.464049:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1790784592.464085:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1790784592.464140:0:15738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359611776:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790784592.464200:0:15738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784592.464244:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359611776 00000100:00100000:3.0:1790784592.464251:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359611776 00000100:00100000:3.0:1790784592.464289:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790784592.464297:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459366ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+19:15738:x1877773359611776:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790784592.464501:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459366ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+19:15738:x1877773359611776:12345-0@lo:502:mount.lustre.0 Request processed in 203us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784592.464508:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790784592.464558:0:15738:0:(client.c:2716:ptlrpc_set_wait()) set ffff945907cdc480 going to sleep for 11 seconds 00000100:00100000:3.0:1790784592.464574:0:15738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359611776:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790784592.464633:0:15738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1790784592.464642:0:15738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1790784592.475898:0:15749:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1790784592.475915:0:15749:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff94593cc699c0) 00000020:00000080:1.0:1790784592.475937:0:15749:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1790784592.476025:0:15749:0:(tgt_mount.c:153:server_get_mount()) get mount ffff945926dbf800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790784592.476030:0:15749:0:(tgt_mount.c:187:server_put_mount()) put mount ffff945926dbf800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790784592.476033:0:15749:0:(obd_mount.c:710:lustre_put_lsi()) put ffff945926dbf800 3 00010000:00080000:1.0:1790784592.476064:0:15749:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94590364c800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.132@tcp at head 00010000:00010000:1.0:1790784592.478059:0:15749:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1790784592.480744:0:15749:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1790784592.480782:0:15749:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790784592.480794:0:15749:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2c3a1e2a079d4931 00000100:00080000:1.0:1790784592.480803:0:15749:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790784592.480813:0:15749:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff94590364c800 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:1.0:1790784592.480846:0:15749:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94592daa0e00 x1877773359611904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790784592.480878:0:15749:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790784592.482554:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3278:1877773359611904:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790784592.482625:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1790784592.482892:0:15749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:3.0:1790784592.483082:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359611904 00000100:00100000:3.0:1790784592.483090:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359611904 00000100:00100000:3.0:1790784592.483273:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790784592.483281:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3278:x1877773359611904:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1790784592.483307:0:14336:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:3.0:1790784592.483338:0:14336:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2c3a1e2a079d4938 00000004:00100000:3.0:1790784592.483352:0:14336:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790784592.483796:0:14336:0:(import.c:65:import_set_state_nolock()) ffff94593f682000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790784592.483908:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1877773359611904:12345-0@lo:38:llog_process_th.0 Request processed in 625us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784592.483916:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1790784592.484079:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94592daa0e00 x1877773359611904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790784602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790784592.484092:0:3278:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790784592.484111:0:3278:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1790784592.484120:0:3278:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:01000000:3.0:1790784592.484566:0:15738:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1790784592.484596:0:15738:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790784592.484649:0:15738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff945802d2f800/0x2c3a1e2a079d491c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4923 expref: -99 pid: 15738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784592.484659:0:15738:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff945802d2f800/0x2c3a1e2a079d491c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4923 expref: -99 pid: 15738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790784592.484705:0:15738:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790784592.484707:0:15738:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790784592.484708:0:15738:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790784592.484710:0:15738:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790784592.484711:0:15738:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790784592.484712:0:15738:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790784592.484714:0:15738:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790784592.484715:0:15738:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790784592.484717:0:15738:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790784592.484721:0:15738:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1790784592.484723:0:15738:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790784592.484724:0:15738:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790784592.484730:0:15738:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790784592.484731:0:15738:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790784592.484732:0:15738:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790784592.484733:0:15738:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790784592.484733:0:15738:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790784592.484734:0:15738:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790784592.484735:0:15738:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790784592.484757:0:15738:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1790784592.484771:0:15738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359612032:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790784592.484815:0:15738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784592.484845:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359612032 00000100:00100000:3.0:1790784592.484851:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359612032 00000100:00100000:3.0:1790784592.484882:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790784592.484890:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459366ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+19:15738:x1877773359612032:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790784592.484909:0:14330:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1790784592.484922:0:14330:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:1.0:1790784592.486394:0:3278:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790784592.486402:0:3278:0:(import.c:65:import_set_state_nolock()) ffff94590364c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790784592.486413:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3278:1877773359611904:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790784592.488224:0:15738:0:(client.c:2716:ptlrpc_set_wait()) set ffff945907cdc480 going to sleep for 11 seconds 20000000:01000000:1.0:1790784592.519845:0:14330:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790784592.519857:0:14330:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1790784592.519877:0:14351:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790784592.519881:0:14351:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790784592.519902:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94590955f600/0x2c3a1e2a079d493f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784592.519920:0:14351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94593c1b1800/0x2c3a1e2a079d4812 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d480b expref: 19 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784592.519928:0:14351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94590955f600/0x2c3a1e2a079d493f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784592.520039:0:14351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94593c1b1800/0x2c3a1e2a079d4812 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d480b expref: 19 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784592.520053:0:14351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94593c1b1800/0x2c3a1e2a079d4812 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d480b expref: 19 pid: 14330 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784592.520066:0:14351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14351:1877773359612160:0@lo:104: 00000100:00100000:1.0:1790784592.520125:0:14351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784592.520576:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359612160 00000100:00100000:2.0:1790784592.520584:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359612160 00000100:00100000:2.0:1790784592.520628:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790784592.520638:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592daa3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+3:14351:x1877773359612160:12345-0@lo:104: 00010000:00010000:2.0:1790784592.520651:0:14319:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff94593fe74e00/0x2c3a1e2a079d480b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d4812 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784592.520700:0:14319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790784592.520706:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592daa3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+3:14351:x1877773359612160:12345-0@lo:104: Request processed in 70us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784592.520712:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790784592.520796:0:14351:0:(client.c:2716:ptlrpc_set_wait()) set ffff945907d8a900 going to sleep for 11 seconds 00000100:00100000:1.0:1790784592.520818:0:14351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14351:1877773359612160:0@lo:104: 00010000:00010000:1.0:1790784592.520841:0:14351:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94590955f600/0x2c3a1e2a079d493f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784592.520939:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790784592.520945:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff94593fe74e00/0x2c3a1e2a079d480b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d4812 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784592.521024:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74e00 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:0.0:1790784592.521028:0:14324:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff94593fe74e00/0x2c3a1e2a079d480b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d4812 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784592.521036:0:14324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff94593fe74e00/0x2c3a1e2a079d480b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d4812 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790784592.521042:0:14324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff94593fe74e00/0x2c3a1e2a079d480b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d4812 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790784592.521048:0:14324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790784592.521082:0:14324:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff94593fe74e00/0x2c3a1e2a079d480b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d4812 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784592.521097:0:14324:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790784592.521117:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff94593fe74e00/0x2c3a1e2a079d480b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d4812 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784592.521124:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff94593fe74e00/0x2c3a1e2a079d480b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d4812 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784592.521150:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784592.521152:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784592.521153:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784592.521231:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3281:1877773359612288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790784592.521265:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784592.521305:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359612288 00000100:00100000:0.0:1790784592.521309:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359612288 00010000:00010000:0.0:1790784592.521327:0:14322:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94593c1b1800/0x2c3a1e2a079d4812 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d480b expref: 20 pid: 14330 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784592.521348:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790784592.521355:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+20:3281:x1877773359612288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790784592.521364:0:14322:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784592.521368:0:14322:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94593c1b1800/0x2c3a1e2a079d4812 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d480b expref: 20 pid: 14330 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784592.521403:0:14322:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94593c1b1800/0x2c3a1e2a079d4812 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d480b expref: 20 pid: 14330 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784592.521416:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94593c1b1800/0x2c3a1e2a079d4812 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d480b expref: 20 pid: 14330 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784592.521441:0:14322:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94590955f600/0x2c3a1e2a079d493f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784592.521449:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94590955f600/0x2c3a1e2a079d493f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790784592.521463:0:14322:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006153122s 00010000:00010000:0.0:1790784592.521468:0:14322:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94590955f600/0x2c3a1e2a079d493f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784592.521474:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94590955f600/0x2c3a1e2a079d493f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784592.521481:0:14322:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94590955f600/0x2c3a1e2a079d493f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784592.521487:0:14322:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94590955f600/0x2c3a1e2a079d493f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784592.521492:0:14322:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955f600 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:0.0:1790784592.521496:0:14322:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94590955f600/0x2c3a1e2a079d493f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784592.521503:0:14322:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94590955f600/0x2c3a1e2a079d493f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784592.521517:0:14322:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94590955f600/0x2c3a1e2a079d493f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784592.521526:0:14322:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790784592.521561:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+19:3281:x1877773359612288:12345-0@lo:103:ldlm_bl.0 Request processed in 207us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784592.521569:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790784592.521600:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3281:1877773359612288:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790784592.521618:0:14351:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94590955f600/0x2c3a1e2a079d493f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784592.521625:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94590955f600/0x2c3a1e2a079d493f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784592.521631:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94590955f600/0x2c3a1e2a079d493f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784592.529922:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459366ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+18:15738:x1877773359612032:12345-0@lo:253:mount.lustre.0 Request processed in 45025us (45098us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784592.529936:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790784592.530054:0:15738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d344380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:43ffae34-ce63-4427-b2f1-54f812a9cb4d:15738:1877773359612032:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790784592.530069:0:15738:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1790784592.530072:0:15738:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790784592.530074:0:15738:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790784592.530075:0:15738:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790784592.530077:0:15738:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790784592.530078:0:15738:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790784592.530079:0:15738:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790784592.530081:0:15738:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790784592.530083:0:15738:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790784592.530084:0:15738:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790784592.530097:0:15738:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1790784592.534528:0:15738:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1790784592.534779:0:15738:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1790784592.534929:0:15738:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1790784592.535090:0:15738:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1790784592.535337:0:15738:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1790784592.535583:0:15738:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1790784592.537421:0:15738:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1790784592.623667:0:15738:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1790784592.623677:0:15738:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1790784592.623715:0:15738:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790784592.623777:0:15738:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.132@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790784592.623789:0:15738:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1790784592.624046:0:15738:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1790784593.018564:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790784593.925081:0:14333:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790784593.925087:0:14333:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94593c4ab000 from 8 10000000:01000000:1.0:1790784593.925091:0:14333:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790784593.925148:0:14333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff94590955e200/0x2c3a1e2a079d4946 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784593.925462:0:14333:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff94590955e200/0x2c3a1e2a079d4946 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784593.925474:0:14333:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff94590955e200/0x2c3a1e2a079d4946 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784593.925499:0:14333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359612416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790784593.925562:0:14333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784593.925615:0:14333:0:(client.c:2716:ptlrpc_set_wait()) set ffff945907d8ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1790784593.927346:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359612416 00000100:00100000:2.0:1790784593.927359:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359612416 00000100:00100000:2.0:1790784593.927422:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790784593.927433:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459366fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+18:14333:x1877773359612416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790784593.927447:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784593.927465:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94593fe74c00/0x2c3a1e2a079d494d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d4946 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784593.927490:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94593fe74c00/0x2c3a1e2a079d494d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d4946 expref: 19 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784593.927501:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94593fe74c00/0x2c3a1e2a079d494d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d4946 expref: 19 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784593.927516:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74c00, rc 0) 00000100:00100000:2.0:1790784593.927575:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459366fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+19:14333:x1877773359612416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (2012us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784593.927582:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790784593.933949:0:14333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359612416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790784593.933977:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff94590955e200/0x2c3a1e2a079d4946 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d494d expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784593.933990:0:14333:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff94590955e200/0x2c3a1e2a079d4946 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d494d expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784593.934070:0:14333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359612544:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790784593.934143:0:14333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784593.934186:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359612544 00000100:00100000:1.0:1790784593.934186:0:14333:0:(client.c:2716:ptlrpc_set_wait()) set ffff945907d8ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1790784593.934193:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359612544 00000100:00100000:2.0:1790784593.934246:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790784593.934255:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459366fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+19:14333:x1877773359612544:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790784593.934274:0:14330:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790784593.934291:0:14330:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790784593.934294:0:14330:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1790784593.934394:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459366fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+19:14333:x1877773359612544:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 140us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784593.934402:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790784593.934436:0:14333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359612544:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790784593.934492:0:14333:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790784593.934498:0:14333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff94590955e200/0x2c3a1e2a079d4946 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d494d expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784593.934507:0:14333:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff94590955e200/0x2c3a1e2a079d4946 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d494d expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784594.045724:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790784594.622774:0:14368:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790784595.066525:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784596.090837:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784597.119984:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790784597.436043:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359612672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790784597.436134:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784597.436228:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359612672 00000100:00100000:1.0:1790784597.436235:0:15023:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359612672 00000100:00100000:1.0:1790784597.436286:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790784597.436299:0:15023:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592daa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359612672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790784597.436335:0:15023:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790784597.436405:0:15023:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592daa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359612672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784597.436414:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1790784597.436435:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790784597.436459:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1790784597.436478:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359612672:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790784597.950003:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790784597.950010:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790784597.950013:0:8:0:(import.c:65:import_set_state_nolock()) ffff94591a8a3000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790784597.950021:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 426 00000100:00080000:0.0:1790784597.950026:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1790784597.950035:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94591a8a3000 using connection 192.168.206.132@tcp/0@lo 00000100:00100000:0.0:1790784597.950054:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94590569e680 x1877773359613056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790784597.950159:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359612928:0@lo:400:kworker.0 00000100:00100000:3.0:1790784597.950172:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3279:1877773359612800:0@lo:400:kworker.0 00000100:00100000:0.0:1790784597.953492:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784597.953552:0:15020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359612928 00000100:00100000:3.0:1790784597.953553:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784597.953562:0:15020:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359612928 00000100:00100000:3.0:1790784597.953849:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359612800 00000100:00100000:3.0:1790784597.953854:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359612800 00000100:00100000:3.0:1790784597.953890:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790784597.953899:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459366fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+19:3279:x1877773359612800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784597.953962:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459366fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+19:3279:x1877773359612800:12345-0@lo:400:kworker.0 Request processed in 64us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784597.953969:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790784597.954317:0:15020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790784597.954327:0:15020:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359612928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784597.954400:0:15020:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359612928:12345-0@lo:400:kworker.0 Request processed in 76us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784597.954407:0:15020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790784597.954797:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359612928:0@lo:400:kworker.0 00000100:00100000:0.0:1790784597.954828:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1877773359613056:0@lo:8:kworker.0 00000100:00100000:0.0:1790784597.954861:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784597.954890:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1877773359613184:0@lo:400:kworker.0 00000100:00100000:0.0:1790784597.954915:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784597.954939:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790784597.954945:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359613312:0@lo:400:kworker.0 00000100:00100000:0.0:1790784597.954966:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784597.954993:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359613184 00000100:00100000:0.0:1790784597.954997:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359613184 00000100:00100000:0.0:1790784597.955025:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359613312 00000100:00100000:0.0:1790784597.955028:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359613312 00000100:00100000:0.0:1790784597.955054:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790784597.955060:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1877773359613184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784597.955120:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1877773359613184:12345-0@lo:400:kworker.0 Request processed in 59us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784597.955127:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790784597.955140:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790784597.955147:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1877773359613312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784597.955173:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1877773359613312:12345-0@lo:400:kworker.0 Request processed in 27us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784597.955179:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1790784597.955200:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790784597.955217:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94590569c700 x1877773359613312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790784613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784597.955229:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3281:1877773359613312:0@lo:400:kworker.0 00010000:00080000:0.0:1790784597.955239:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94590569ed80 x1877773359613184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790784613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784597.955248:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1877773359613184:0@lo:400:kworker.0 00000100:00100000:3.0:1790784597.956709:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359613056 00000100:00100000:3.0:1790784597.956731:0:15022:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359613056 00000100:00100000:3.0:1790784597.956765:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790784597.956772:0:15022:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3278:x1877773359613056:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1790784597.956799:0:15022:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 432 last 0 00000020:00000080:3.0:1790784597.956826:0:15022:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2c3a1e2a079d4954 00002000:00100000:3.0:1790784597.956839:0:15022:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff94593f686800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1790784597.956843:0:15022:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1790784597.956846:0:15022:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1790784597.957172:0:15022:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790784597.957198:0:15022:0:(import.c:65:import_set_state_nolock()) ffff94593f685800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790784597.957267:0:15022:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3278:x1877773359613056:12345-0@lo:8:kworker.0 Request processed in 494us (2405us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784597.957287:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790784597.957350:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3279:1877773359612800:0@lo:400:kworker.0 00000100:00100000:3.0:1790784597.957360:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590569df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1877773359613440:0@lo:400:kworker.0 00000100:00100000:3.0:1790784597.957416:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1790784597.959205:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94590569e680 x1877773359613056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790784622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784597.959220:0:3278:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790784597.959229:0:3278:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1790784597.959237:0:3278:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790784597.959243:0:3278:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1790784597.959246:0:3278:0:(import.c:65:import_set_state_nolock()) ffff94591a8a3000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790784597.959411:0:14360:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1790784597.959432:0:14360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d346a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14360:1877773359613696:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1790784597.959479:0:14360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784597.959503:0:14360:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459011ca0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790784597.959522:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359613696 00000100:00100000:3.0:1790784597.959528:0:15022:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359613696 00000100:00100000:3.0:1790784597.959576:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790784597.959585:0:15022:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d345880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14360:x1877773359613696:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1790784597.959926:0:3278:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790784597.959934:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3278:1877773359613056:0@lo:8:kworker.0 00000100:00100000:0.0:1790784597.959976:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359613440 00000100:00100000:0.0:1790784597.959981:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359613440 00000100:00100000:0.0:1790784597.960014:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790784597.960020:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1877773359613440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784597.960059:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1877773359613440:12345-0@lo:400:kworker.0 Request processed in 40us (2643us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784597.960065:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1790784597.960084:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790784597.960088:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790784597.960112:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359613568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790784597.960140:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784597.960171:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359613568 00000100:00100000:0.0:1790784597.960174:0:15023:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359613568 00000100:00100000:0.0:1790784597.960213:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790784597.960221:0:15023:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1877773359613568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790784597.960243:0:15023:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790784597.960276:0:15023:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1877773359613568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784597.960282:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790784597.960363:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94592d345c00 x1877773359613568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790784613 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790784597.960393:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359613568:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1790784597.962677:0:14359:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790784597.963255:0:14359:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 432112878191ns, next at 0ns, rc = 0 00002000:00080000:3.0:1790784597.970289:0:15022:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1790784597.970299:0:15022:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1790784597.970311:0:15022:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00010000:00080000:2.0:1790784597.973457:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94590569df80 x1877773359613440/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790784613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790784597.973478:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590569df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1877773359613440:0@lo:400:kworker.0 00002000:00010000:3.0:1790784597.985249:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790784597.985260:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004517065/0x2c3a1e2a079d495b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.985275:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1790784597.985280:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784597.985286:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004517065/0x2c3a1e2a079d495b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.985303:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004517065/0x2c3a1e2a079d495b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.985313:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004517065/0x2c3a1e2a079d495b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.985320:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004517065/0x2c3a1e2a079d495b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.985545:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790784597.986946:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790784597.986957:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008947e36a/0x2c3a1e2a079d4962 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784597.986968:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790784597.986971:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1790784597.986977:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790784597.986979:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004517065/0x2c3a1e2a079d495b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.986982:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008947e36a/0x2c3a1e2a079d4962 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784597.986990:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2e000 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:2.0:1790784597.986997:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004517065/0x2c3a1e2a079d495b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.987007:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008947e36a/0x2c3a1e2a079d4962 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784597.987010:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004517065/0x2c3a1e2a079d495b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.987025:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008947e36a/0x2c3a1e2a079d4962 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.987034:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008947e36a/0x2c3a1e2a079d4962 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784597.987038:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004517065/0x2c3a1e2a079d495b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784597.987047:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004517065/0x2c3a1e2a079d495b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.987051:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790784597.987066:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790784597.987076:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008947e36a/0x2c3a1e2a079d4962 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784597.987083:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2ee00 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:2.0:1790784597.987086:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008947e36a/0x2c3a1e2a079d4962 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784597.987094:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008947e36a/0x2c3a1e2a079d4962 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784597.987115:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008947e36a/0x2c3a1e2a079d4962 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784597.987121:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008947e36a/0x2c3a1e2a079d4962 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784597.987134:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784597.987135:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784597.987137:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784597.987967:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790784597.988846:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790784597.988855:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7f45421/0x2c3a1e2a079d4969 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.988870:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1790784597.988874:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784597.988880:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7f45421/0x2c3a1e2a079d4969 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.988891:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7f45421/0x2c3a1e2a079d4969 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.988902:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7f45421/0x2c3a1e2a079d4969 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.988920:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7f45421/0x2c3a1e2a079d4969 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.988939:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790784597.989737:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790784597.989745:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f93c94ac/0x2c3a1e2a079d4970 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.989754:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1790784597.989757:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784597.989762:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f93c94ac/0x2c3a1e2a079d4970 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.989773:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f93c94ac/0x2c3a1e2a079d4970 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.989781:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f93c94ac/0x2c3a1e2a079d4970 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.989788:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f93c94ac/0x2c3a1e2a079d4970 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.989805:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790784597.989819:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790784597.989824:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7f45421/0x2c3a1e2a079d4969 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.989838:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2ea00 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:3.0:1790784597.989842:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7f45421/0x2c3a1e2a079d4969 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.989852:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7f45421/0x2c3a1e2a079d4969 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.989867:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7f45421/0x2c3a1e2a079d4969 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.989874:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7f45421/0x2c3a1e2a079d4969 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.989889:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790784597.989893:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f93c94ac/0x2c3a1e2a079d4970 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.989898:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2f600 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:3.0:1790784597.989901:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f93c94ac/0x2c3a1e2a079d4970 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.989907:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f93c94ac/0x2c3a1e2a079d4970 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.989914:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f93c94ac/0x2c3a1e2a079d4970 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.989926:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f93c94ac/0x2c3a1e2a079d4970 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.989937:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784597.989938:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784597.989940:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790784597.990869:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790784597.990877:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9047d87/0x2c3a1e2a079d4977 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.990889:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1790784597.990892:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784597.990898:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9047d87/0x2c3a1e2a079d4977 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.990908:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9047d87/0x2c3a1e2a079d4977 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.990916:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9047d87/0x2c3a1e2a079d4977 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.990923:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9047d87/0x2c3a1e2a079d4977 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.990938:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790784597.990947:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790784597.990956:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9047d87/0x2c3a1e2a079d4977 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.990963:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2e600 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:3.0:1790784597.990967:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9047d87/0x2c3a1e2a079d4977 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.990975:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9047d87/0x2c3a1e2a079d4977 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.990988:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9047d87/0x2c3a1e2a079d4977 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.990996:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9047d87/0x2c3a1e2a079d4977 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.991010:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784597.991012:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784597.991014:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790784597.991898:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790784597.991906:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088225138/0x2c3a1e2a079d497e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.991916:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1790784597.991920:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784597.991925:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088225138/0x2c3a1e2a079d497e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.991947:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088225138/0x2c3a1e2a079d497e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.991955:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088225138/0x2c3a1e2a079d497e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.991962:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088225138/0x2c3a1e2a079d497e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.992313:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790784597.992329:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790784597.992475:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088225138/0x2c3a1e2a079d497e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.992484:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2e200 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:3.0:1790784597.992489:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088225138/0x2c3a1e2a079d497e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.992498:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088225138/0x2c3a1e2a079d497e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.992511:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088225138/0x2c3a1e2a079d497e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.992518:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088225138/0x2c3a1e2a079d497e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.992541:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784597.992543:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784597.992545:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790784597.993350:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790784597.993358:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056f084b1/0x2c3a1e2a079d4985 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.993370:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1790784597.993521:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784597.993528:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056f084b1/0x2c3a1e2a079d4985 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.993540:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056f084b1/0x2c3a1e2a079d4985 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.993549:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056f084b1/0x2c3a1e2a079d4985 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.993629:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056f084b1/0x2c3a1e2a079d4985 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.993651:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790784597.993662:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790784597.993667:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056f084b1/0x2c3a1e2a079d4985 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.993686:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2f400 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:3.0:1790784597.993690:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056f084b1/0x2c3a1e2a079d4985 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.993700:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056f084b1/0x2c3a1e2a079d4985 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.993712:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056f084b1/0x2c3a1e2a079d4985 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.993719:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056f084b1/0x2c3a1e2a079d4985 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.993735:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784597.993737:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784597.993739:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790784597.996368:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790784597.996553:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baa7bc2b/0x2c3a1e2a079d498c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.996631:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1790784597.996636:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784597.996642:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baa7bc2b/0x2c3a1e2a079d498c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.996656:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000baa7bc2b/0x2c3a1e2a079d498c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.996673:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baa7bc2b/0x2c3a1e2a079d498c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.996680:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000baa7bc2b/0x2c3a1e2a079d498c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.996696:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790784597.996709:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790784597.996715:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000baa7bc2b/0x2c3a1e2a079d498c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.996722:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2e800 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:3.0:1790784597.996726:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000baa7bc2b/0x2c3a1e2a079d498c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.996735:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000baa7bc2b/0x2c3a1e2a079d498c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.996751:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000baa7bc2b/0x2c3a1e2a079d498c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.996759:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baa7bc2b/0x2c3a1e2a079d498c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.996780:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784597.996787:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784597.996788:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784597.996986:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790784597.997834:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790784597.997842:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d4993 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.997853:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1790784597.997857:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784597.997862:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d4993 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.997873:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d4993 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.997882:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d4993 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.997888:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d4993 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.997916:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790784597.998003:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790784597.998010:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d4993 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784597.998019:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2f000 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:1.0:1790784597.998023:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d4993 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784597.998044:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d4993 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784597.998060:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d4993 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784597.998068:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d4993 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784597.998086:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784597.998088:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784597.998089:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790784597.999055:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790784597.999077:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000998897cf/0x2c3a1e2a079d499a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.999089:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1790784597.999093:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784597.999107:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000998897cf/0x2c3a1e2a079d499a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.999126:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000998897cf/0x2c3a1e2a079d499a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.999144:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000998897cf/0x2c3a1e2a079d499a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.999151:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000998897cf/0x2c3a1e2a079d499a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.999168:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790784597.999655:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790784597.999662:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000696af2dd/0x2c3a1e2a079d49a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.999671:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1790784597.999674:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784597.999678:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000696af2dd/0x2c3a1e2a079d49a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.999688:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000696af2dd/0x2c3a1e2a079d49a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.999697:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000696af2dd/0x2c3a1e2a079d49a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.999715:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000696af2dd/0x2c3a1e2a079d49a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784597.999728:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790784598.000126:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790784598.000133:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000998897cf/0x2c3a1e2a079d499a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.000142:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2f200 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:2.0:1790784598.000147:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000998897cf/0x2c3a1e2a079d499a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.000166:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000998897cf/0x2c3a1e2a079d499a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.000181:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000998897cf/0x2c3a1e2a079d499a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.000188:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000998897cf/0x2c3a1e2a079d499a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.000207:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790784598.000210:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000696af2dd/0x2c3a1e2a079d49a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.000216:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2ec00 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:2.0:1790784598.000219:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000696af2dd/0x2c3a1e2a079d49a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.000226:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000696af2dd/0x2c3a1e2a079d49a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.000235:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000696af2dd/0x2c3a1e2a079d49a1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.000241:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000696af2dd/0x2c3a1e2a079d49a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.000264:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784598.000266:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784598.000267:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784598.000498:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790784598.001137:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790784598.001145:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f93c94ac/0x2c3a1e2a079d49a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.001156:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1790784598.001160:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784598.001165:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f93c94ac/0x2c3a1e2a079d49a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.001176:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f93c94ac/0x2c3a1e2a079d49a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.001184:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f93c94ac/0x2c3a1e2a079d49a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.001192:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f93c94ac/0x2c3a1e2a079d49a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.001209:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790784598.001928:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790784598.001935:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7f45421/0x2c3a1e2a079d49af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.001950:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1790784598.001954:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784598.001959:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7f45421/0x2c3a1e2a079d49af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.001970:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7f45421/0x2c3a1e2a079d49af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.002286:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790784598.002293:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f93c94ac/0x2c3a1e2a079d49a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.002303:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2f600 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:2.0:1790784598.002308:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f93c94ac/0x2c3a1e2a079d49a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.002318:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f93c94ac/0x2c3a1e2a079d49a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.002334:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f93c94ac/0x2c3a1e2a079d49a8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.002342:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f93c94ac/0x2c3a1e2a079d49a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.002359:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784598.002361:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784598.002364:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784598.004659:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7f45421/0x2c3a1e2a079d49af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.004675:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7f45421/0x2c3a1e2a079d49af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.004704:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790784598.005398:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790784598.005406:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000182618ad/0x2c3a1e2a079d49b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.005419:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1790784598.005423:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784598.005429:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000182618ad/0x2c3a1e2a079d49b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.005445:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000182618ad/0x2c3a1e2a079d49b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.005465:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000182618ad/0x2c3a1e2a079d49b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.005471:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000182618ad/0x2c3a1e2a079d49b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.019090:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790784598.029751:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790784598.029766:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7f45421/0x2c3a1e2a079d49af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.029799:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2ea00 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:2.0:1790784598.029805:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7f45421/0x2c3a1e2a079d49af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.029816:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7f45421/0x2c3a1e2a079d49af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.029837:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7f45421/0x2c3a1e2a079d49af lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.029845:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7f45421/0x2c3a1e2a079d49af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.029874:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790784598.029878:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000182618ad/0x2c3a1e2a079d49b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.029885:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030c00 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:2.0:1790784598.029889:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000182618ad/0x2c3a1e2a079d49b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.029897:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000182618ad/0x2c3a1e2a079d49b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.029906:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000182618ad/0x2c3a1e2a079d49b6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.029920:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000182618ad/0x2c3a1e2a079d49b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.029936:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784598.029938:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784598.029940:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784598.037898:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790784598.039037:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790784598.039048:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9850aec/0x2c3a1e2a079d49bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.039076:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1790784598.039080:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784598.039087:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9850aec/0x2c3a1e2a079d49bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.039108:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9850aec/0x2c3a1e2a079d49bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.039118:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9850aec/0x2c3a1e2a079d49bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.039127:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9850aec/0x2c3a1e2a079d49bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.039156:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790784598.039905:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790784598.039915:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9850aec/0x2c3a1e2a079d49bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.039926:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030e00 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:2.0:1790784598.039931:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9850aec/0x2c3a1e2a079d49bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.039942:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9850aec/0x2c3a1e2a079d49bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.039960:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9850aec/0x2c3a1e2a079d49bd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.039967:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9850aec/0x2c3a1e2a079d49bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.039987:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784598.039989:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784598.039992:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790784598.042294:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790784598.042306:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060693e62/0x2c3a1e2a079d49c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.042322:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1790784598.042326:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784598.042345:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060693e62/0x2c3a1e2a079d49c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.042358:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060693e62/0x2c3a1e2a079d49c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.042367:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060693e62/0x2c3a1e2a079d49c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.042496:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060693e62/0x2c3a1e2a079d49c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.042515:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790784598.042529:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790784598.042540:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060693e62/0x2c3a1e2a079d49c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.042548:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030000 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:3.0:1790784598.042559:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060693e62/0x2c3a1e2a079d49c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.042569:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060693e62/0x2c3a1e2a079d49c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.042585:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060693e62/0x2c3a1e2a079d49c4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.042593:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060693e62/0x2c3a1e2a079d49c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.042610:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784598.042612:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784598.042614:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790784598.043262:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790784598.043269:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d49cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.043280:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1790784598.043284:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784598.043288:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d49cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.043299:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d49cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.043307:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d49cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.043319:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d49cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.047455:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790784598.048260:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790784598.048270:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d49cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.048283:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900031800 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:2.0:1790784598.048288:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d49cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.048300:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d49cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.048341:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d49cb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.048349:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d49cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.048572:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784598.048575:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784598.048577:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790784598.049138:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790784598.049146:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baa7bc2b/0x2c3a1e2a079d49d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.049158:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1790784598.049162:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784598.049168:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baa7bc2b/0x2c3a1e2a079d49d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.049180:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000baa7bc2b/0x2c3a1e2a079d49d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.049189:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baa7bc2b/0x2c3a1e2a079d49d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.049197:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000baa7bc2b/0x2c3a1e2a079d49d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.049216:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790784598.049328:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790784598.049334:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000baa7bc2b/0x2c3a1e2a079d49d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.049343:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2e800 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:2.0:1790784598.049347:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000baa7bc2b/0x2c3a1e2a079d49d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.049368:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000baa7bc2b/0x2c3a1e2a079d49d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.049484:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000baa7bc2b/0x2c3a1e2a079d49d2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.049492:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baa7bc2b/0x2c3a1e2a079d49d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.049631:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784598.049634:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784598.049636:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790784598.051552:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790784598.051562:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056f084b1/0x2c3a1e2a079d49d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.051583:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1790784598.051587:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784598.051594:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056f084b1/0x2c3a1e2a079d49d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.051606:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056f084b1/0x2c3a1e2a079d49d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.051615:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056f084b1/0x2c3a1e2a079d49d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.051623:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056f084b1/0x2c3a1e2a079d49d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.051640:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790784598.052693:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790784598.052702:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088225138/0x2c3a1e2a079d49e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.052713:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1790784598.052716:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784598.052721:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088225138/0x2c3a1e2a079d49e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.052734:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088225138/0x2c3a1e2a079d49e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.052755:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088225138/0x2c3a1e2a079d49e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.052811:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088225138/0x2c3a1e2a079d49e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.052826:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790784598.053305:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790784598.053313:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056f084b1/0x2c3a1e2a079d49d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.053321:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2f400 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:2.0:1790784598.053326:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056f084b1/0x2c3a1e2a079d49d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.053336:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056f084b1/0x2c3a1e2a079d49d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.053353:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056f084b1/0x2c3a1e2a079d49d9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.054220:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056f084b1/0x2c3a1e2a079d49d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.054244:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790784598.054248:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088225138/0x2c3a1e2a079d49e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.054254:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2e200 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:2.0:1790784598.054258:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088225138/0x2c3a1e2a079d49e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.054266:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088225138/0x2c3a1e2a079d49e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.054278:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088225138/0x2c3a1e2a079d49e0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.054285:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088225138/0x2c3a1e2a079d49e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.054296:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784598.054298:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784598.054300:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784598.054306:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790784598.054482:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790784598.054489:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d49e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.054500:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1790784598.054504:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784598.054509:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d49e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.054521:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d49e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.054531:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d49e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.054538:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d49e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.054564:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790784598.055282:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790784598.055290:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008947e36a/0x2c3a1e2a079d49ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.055301:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1790784598.055304:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784598.055309:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008947e36a/0x2c3a1e2a079d49ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.055319:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008947e36a/0x2c3a1e2a079d49ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.055329:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008947e36a/0x2c3a1e2a079d49ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.055487:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008947e36a/0x2c3a1e2a079d49ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.055500:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790784598.055618:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790784598.055627:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d49e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784598.055651:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2f000 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:0.0:1790784598.055657:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d49e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784598.055668:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d49e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784598.055690:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d49e7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784598.055699:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000810546d4/0x2c3a1e2a079d49e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784598.055725:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790784598.055730:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008947e36a/0x2c3a1e2a079d49ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784598.055737:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2ee00 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:0.0:1790784598.055741:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008947e36a/0x2c3a1e2a079d49ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784598.055749:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008947e36a/0x2c3a1e2a079d49ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784598.055761:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008947e36a/0x2c3a1e2a079d49ee lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784598.055775:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008947e36a/0x2c3a1e2a079d49ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784598.055790:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784598.055791:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784598.055793:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790784598.056025:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790784598.056031:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004517065/0x2c3a1e2a079d49f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.056040:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1790784598.056048:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784598.056053:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004517065/0x2c3a1e2a079d49f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.056064:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004517065/0x2c3a1e2a079d49f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.056072:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004517065/0x2c3a1e2a079d49f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.056080:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004517065/0x2c3a1e2a079d49f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.056109:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790784598.056367:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790784598.056465:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004517065/0x2c3a1e2a079d49f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.056480:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2e000 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:2.0:1790784598.056483:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004517065/0x2c3a1e2a079d49f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.056493:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004517065/0x2c3a1e2a079d49f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.056504:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004517065/0x2c3a1e2a079d49f5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.056511:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004517065/0x2c3a1e2a079d49f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.056525:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784598.056526:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784598.056528:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790784598.056656:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790784598.056663:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9047d87/0x2c3a1e2a079d49fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.056672:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1790784598.056675:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784598.056679:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9047d87/0x2c3a1e2a079d49fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.056688:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9047d87/0x2c3a1e2a079d49fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.056696:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9047d87/0x2c3a1e2a079d49fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.056708:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9047d87/0x2c3a1e2a079d49fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.056725:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790784598.056843:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790784598.056848:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9047d87/0x2c3a1e2a079d49fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.056855:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2e600 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:2.0:1790784598.056858:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9047d87/0x2c3a1e2a079d49fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.056865:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9047d87/0x2c3a1e2a079d49fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.056881:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9047d87/0x2c3a1e2a079d49fc lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.056888:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9047d87/0x2c3a1e2a079d49fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.056902:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784598.056905:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784598.056906:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790784598.057690:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790784598.057698:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7f45421/0x2c3a1e2a079d4a03 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.057708:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1790784598.057711:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784598.057716:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7f45421/0x2c3a1e2a079d4a03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.057726:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7f45421/0x2c3a1e2a079d4a03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.057733:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7f45421/0x2c3a1e2a079d4a03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.057740:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7f45421/0x2c3a1e2a079d4a03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.057756:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790784598.058191:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790784598.058198:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f93c94ac/0x2c3a1e2a079d4a0a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.058214:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1790784598.058216:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784598.058221:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f93c94ac/0x2c3a1e2a079d4a0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.058230:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f93c94ac/0x2c3a1e2a079d4a0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.058239:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f93c94ac/0x2c3a1e2a079d4a0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.058247:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f93c94ac/0x2c3a1e2a079d4a0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.058257:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790784598.058691:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790784598.058698:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7f45421/0x2c3a1e2a079d4a03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.058706:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2ea00 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:2.0:1790784598.058711:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7f45421/0x2c3a1e2a079d4a03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.058719:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7f45421/0x2c3a1e2a079d4a03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.058733:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7f45421/0x2c3a1e2a079d4a03 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.058739:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7f45421/0x2c3a1e2a079d4a03 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.058780:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790784598.058784:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f93c94ac/0x2c3a1e2a079d4a0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.058791:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2f600 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:2.0:1790784598.058794:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f93c94ac/0x2c3a1e2a079d4a0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.058801:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f93c94ac/0x2c3a1e2a079d4a0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.058812:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f93c94ac/0x2c3a1e2a079d4a0a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.058819:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f93c94ac/0x2c3a1e2a079d4a0a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784598.058831:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784598.058833:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784598.058834:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790784598.058929:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790784598.058936:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000696af2dd/0x2c3a1e2a079d4a11 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.058945:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1790784598.058948:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790784598.058952:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000696af2dd/0x2c3a1e2a079d4a11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.058962:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000696af2dd/0x2c3a1e2a079d4a11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.058982:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000696af2dd/0x2c3a1e2a079d4a11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.058989:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000696af2dd/0x2c3a1e2a079d4a11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784598.059001:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790784598.059036:0:14324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790784598.059044:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000696af2dd/0x2c3a1e2a079d4a11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784598.059054:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2ec00 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:0.0:1790784598.059058:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000696af2dd/0x2c3a1e2a079d4a11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784598.059067:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000696af2dd/0x2c3a1e2a079d4a11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784598.059081:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000696af2dd/0x2c3a1e2a079d4a11 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784598.059087:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000696af2dd/0x2c3a1e2a079d4a11 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784598.059122:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784598.059126:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790784598.059130:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1790784598.059201:0:15022:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00010000:00010000:2.0:1790784598.059240:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784598.059293:0:15022:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d345880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14360:x1877773359613696:12345-0@lo:5:osp-pre-1-0.0 Request processed in 99707us (99811us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784598.059302:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790784598.059834:0:14360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d346a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14360:1877773359613696:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1790784598.059849:0:14360:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:2.0:1790784598.059892:0:14360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9cdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14360:1877773359613824:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1790784598.059936:0:14360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784598.059966:0:15020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359613824 00000100:00100000:2.0:1790784598.059970:0:14360:0:(client.c:2716:ptlrpc_set_wait()) set ffff945905135840 going to sleep for 11 seconds 00000100:00100000:3.0:1790784598.059972:0:15020:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359613824 00000100:00100000:3.0:1790784598.060012:0:15020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790784598.060022:0:15020:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14360:x1877773359613824:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1790784598.060058:0:15020:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000004:00080000:1.0:1790784598.071408:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1790784598.073151:0:15020:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14360:x1877773359613824:12345-0@lo:5:osp-pre-1-0.0 Request processed in 13124us (13208us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1790784598.073164:0:15020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790784598.073304:0:14360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9cdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14360:1877773359613824:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1790784598.073326:0:14360:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:3.0:1790784598.140161:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784599.164315:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790784599.790906:0:16095:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg632-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790784600.186697:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784601.211674:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784602.072890:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784602.073003:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344940160 00000100:00100000:2.0:1790784602.073013:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344940160 00000100:00100000:2.0:1790784602.073056:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 75 00000100:00100000:2.0:1790784602.073063:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2348:x1877773344940160:12345-192.168.206.32@tcp:250:mount.lustre.0 00010000:00080000:2.0:1790784602.073101:0:14329:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 9cd6e380-086e-4f8a-8222-c63218e0c889@192.168.206.32@tcp t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:2.0:1790784602.073128:0:14329:0:(genops.c:1384:class_connect()) connect: client 9cd6e380-086e-4f8a-8222-c63218e0c889, cookie 0x2c3a1e2a079d4a18 00000100:00080000:2.0:1790784602.073256:0:14329:0:(import.c:65:import_set_state_nolock()) ffff945920cbb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790784602.073325:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9cd6e380-086e-4f8a-8222-c63218e0c889+5:2348:x1877773344940160:12345-192.168.206.32@tcp:250:mount.lustre.0 Request processed in 260us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784602.073333:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 75 00000100:00100000:0.0:1790784602.090218:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784602.090322:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344940288 00000100:00100000:2.0:1790784602.090332:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344940288 00000100:00100000:2.0:1790784602.090434:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 76 00000100:00100000:2.0:1790784602.090445:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9cd6e380-086e-4f8a-8222-c63218e0c889+5:13725:x1877773344940288:12345-192.168.206.32@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790784602.090462:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784602.090478:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94593fe74a00/0x2c3a1e2a079d4a1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x394e0d8838135378 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784602.090505:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94593fe74a00/0x2c3a1e2a079d4a1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135378 expref: 6 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784602.090535:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94593fe74a00/0x2c3a1e2a079d4a1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135378 expref: 6 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784602.090544:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74a00, rc 0) 00000100:00100000:2.0:1790784602.090605:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9cd6e380-086e-4f8a-8222-c63218e0c889+6:13725:x1877773344940288:12345-192.168.206.32@tcp:101:mount.lustre.0 Request processed in 162us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784602.090612:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 76 00000100:00100000:1.0:1790784602.103978:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784602.104128:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344940416 00000100:00100000:3.0:1790784602.104139:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344940416 00000100:00100000:3.0:1790784602.104273:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 77 00000100:00100000:3.0:1790784602.104285:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d728850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9cd6e380-086e-4f8a-8222-c63218e0c889+6:13725:x1877773344940416:12345-192.168.206.32@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790784602.104596:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d728850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9cd6e380-086e-4f8a-8222-c63218e0c889+6:13725:x1877773344940416:12345-192.168.206.32@tcp:501:mount.lustre.0 Request processed in 314us (626us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790784602.104605:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 77 00000100:00100000:1.0:1790784602.115202:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784602.116947:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344940544 00000100:00100000:3.0:1790784602.116959:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344940544 00000100:00100000:3.0:1790784602.117026:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 78 00000100:00100000:3.0:1790784602.117036:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9cd6e380-086e-4f8a-8222-c63218e0c889+6:13725:x1877773344940544:12345-192.168.206.32@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790784602.117051:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784602.117067:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945802d2f200/0x2c3a1e2a079d4a26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x394e0d883813537f expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784602.117104:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945802d2f200/0x2c3a1e2a079d4a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813537f expref: 7 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784602.117116:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945802d2f200/0x2c3a1e2a079d4a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813537f expref: 7 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784602.117125:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945802d2f200, rc 0) 00000100:00100000:3.0:1790784602.117182:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9cd6e380-086e-4f8a-8222-c63218e0c889+7:13725:x1877773344940544:12345-192.168.206.32@tcp:101:mount.lustre.0 Request processed in 148us (1988us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784602.117189:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 78 00000100:00100000:0.0:1790784602.120775:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784602.120902:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344940672 00000100:00100000:3.0:1790784602.120911:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344940672 00000100:00100000:3.0:1790784602.120964:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 79 00000100:00100000:3.0:1790784602.120973:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9cd6e380-086e-4f8a-8222-c63218e0c889+7:13725:x1877773344940672:12345-192.168.206.32@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790784602.121269:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9cd6e380-086e-4f8a-8222-c63218e0c889+8:13725:x1877773344940672:12345-192.168.206.32@tcp:501:mount.lustre.0 Request processed in 296us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784602.121277:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 79 00000100:00100000:1.0:1790784602.130518:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784602.130617:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344940800 00000100:00100000:0.0:1790784602.130629:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344940800 00000100:00100000:0.0:1790784602.130687:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 80 00000100:00100000:0.0:1790784602.130698:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9cd6e380-086e-4f8a-8222-c63218e0c889+8:13725:x1877773344940800:12345-192.168.206.32@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790784602.130924:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9cd6e380-086e-4f8a-8222-c63218e0c889+8:13725:x1877773344940800:12345-192.168.206.32@tcp:503:mount.lustre.0 Request processed in 227us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784602.130932:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 80 00000100:00100000:1.0:1790784602.146030:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784602.146625:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344940928 00000100:00100000:0.0:1790784602.146636:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344940928 00000100:00100000:0.0:1790784602.146698:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 81 00000100:00100000:0.0:1790784602.146708:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9cd6e380-086e-4f8a-8222-c63218e0c889+8:13743:x1877773344940928:12345-192.168.206.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790784602.146966:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9cd6e380-086e-4f8a-8222-c63218e0c889+8:13743:x1877773344940928:12345-192.168.206.32@tcp:502:llog_process_th.0 Request processed in 259us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784602.146974:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 81 00000100:00100000:1.0:1790784602.163632:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784602.163748:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344941056 00000100:00100000:3.0:1790784602.163758:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344941056 00000100:00100000:3.0:1790784602.163816:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 82 00000100:00100000:3.0:1790784602.163824:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9cd6e380-086e-4f8a-8222-c63218e0c889+8:13743:x1877773344941056:12345-192.168.206.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790784602.164098:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9cd6e380-086e-4f8a-8222-c63218e0c889+8:13743:x1877773344941056:12345-192.168.206.32@tcp:502:llog_process_th.0 Request processed in 274us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784602.164106:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 82 00000100:00100000:1.0:1790784602.171095:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784602.171231:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344941184 00000100:00100000:0.0:1790784602.171241:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344941184 00000100:00100000:0.0:1790784602.171299:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 83 00000100:00100000:0.0:1790784602.171310:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d729450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9cd6e380-086e-4f8a-8222-c63218e0c889+8:13725:x1877773344941184:12345-192.168.206.32@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790784602.171422:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784602.171441:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94593c1b1800/0x2c3a1e2a079d4a2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x394e0d88381353a9 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784602.171469:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94593c1b1800/0x2c3a1e2a079d4a2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381353a9 expref: 9 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784602.171497:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94593c1b1800/0x2c3a1e2a079d4a2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381353a9 expref: 9 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784602.171507:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b1800, rc 0) 00000100:00100000:0.0:1790784602.171555:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d729450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9cd6e380-086e-4f8a-8222-c63218e0c889+9:13725:x1877773344941184:12345-192.168.206.32@tcp:101:mount.lustre.0 Request processed in 248us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784602.171561:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 83 00000100:00100000:1.0:1790784602.174006:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784602.174089:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344941312 00000100:00100000:3.0:1790784602.174098:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344941312 00000100:00100000:3.0:1790784602.174242:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 84 00000100:00100000:3.0:1790784602.174252:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9cd6e380-086e-4f8a-8222-c63218e0c889+9:13725:x1877773344941312:12345-192.168.206.32@tcp:256:mount.lustre.0 20000000:01000000:3.0:1790784602.174275:0:14328:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1790784602.174294:0:14328:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790784602.174298:0:14328:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1790784602.174301:0:14328:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1790784602.174303:0:14328:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1790784602.176927:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9cd6e380-086e-4f8a-8222-c63218e0c889+9:13725:x1877773344941312:12345-192.168.206.32@tcp:256:mount.lustre.0 Request processed in 2654us (2905us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784602.176945:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 84 00000100:00100000:1.0:1790784602.183958:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784602.184123:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344941440 00000100:00100000:2.0:1790784602.184136:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344941440 00000100:00100000:2.0:1790784602.184207:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 85 00000100:00100000:2.0:1790784602.184220:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9cd6e380-086e-4f8a-8222-c63218e0c889+9:13725:x1877773344941440:12345-192.168.206.32@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790784602.184244:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784602.184269:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94593fe74600/0x2c3a1e2a079d4a34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x394e0d88381353b0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784602.184310:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94593fe74600/0x2c3a1e2a079d4a34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381353b0 expref: 10 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784602.184323:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94593fe74600/0x2c3a1e2a079d4a34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381353b0 expref: 10 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784602.184334:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74600, rc 0) 00000100:00100000:2.0:1790784602.184510:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9cd6e380-086e-4f8a-8222-c63218e0c889+10:13725:x1877773344941440:12345-192.168.206.32@tcp:101:mount.lustre.0 Request processed in 291us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784602.184517:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 85 00000100:00100000:1.0:1790784602.188354:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784602.188505:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344941568 00000100:00100000:3.0:1790784602.188517:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344941568 00000100:00100000:3.0:1790784602.188583:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 86 00000100:00100000:3.0:1790784602.188596:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d729850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9cd6e380-086e-4f8a-8222-c63218e0c889+10:13725:x1877773344941568:12345-192.168.206.32@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790784602.189354:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d729850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9cd6e380-086e-4f8a-8222-c63218e0c889+10:13725:x1877773344941568:12345-192.168.206.32@tcp:501:mount.lustre.0 Request processed in 758us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784602.189366:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 86 00000100:00100000:1.0:1790784602.194505:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784602.194748:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344941696 00000100:00100000:2.0:1790784602.194782:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344941696 00000100:00100000:2.0:1790784602.195099:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 87 00000100:00100000:2.0:1790784602.195125:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9cd6e380-086e-4f8a-8222-c63218e0c889+10:13725:x1877773344941696:12345-192.168.206.32@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790784602.195486:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9cd6e380-086e-4f8a-8222-c63218e0c889+10:13725:x1877773344941696:12345-192.168.206.32@tcp:503:mount.lustre.0 Request processed in 373us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784602.195495:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 87 00000100:00100000:1.0:1790784602.205899:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784602.206393:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344941824 00000100:00100000:3.0:1790784602.206407:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344941824 00000100:00100000:3.0:1790784602.206497:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 88 00000100:00100000:3.0:1790784602.206513:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9cd6e380-086e-4f8a-8222-c63218e0c889+10:13748:x1877773344941824:12345-192.168.206.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790784602.207263:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9cd6e380-086e-4f8a-8222-c63218e0c889+10:13748:x1877773344941824:12345-192.168.206.32@tcp:502:llog_process_th.0 Request processed in 752us (1478us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784602.207276:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 88 00000100:00100000:1.0:1790784602.211214:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784602.212260:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344941952 00000100:00100000:2.0:1790784602.212276:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344941952 00000100:00100000:2.0:1790784602.212347:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 89 00000100:00100000:2.0:1790784602.212357:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9cd6e380-086e-4f8a-8222-c63218e0c889+10:13748:x1877773344941952:12345-192.168.206.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790784602.212639:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9cd6e380-086e-4f8a-8222-c63218e0c889+10:13748:x1877773344941952:12345-192.168.206.32@tcp:502:llog_process_th.0 Request processed in 283us (1440us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784602.212647:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 89 00000100:00100000:3.0:1790784602.230787:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784602.231003:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344942080 00000100:00100000:2.0:1790784602.231017:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344942080 00000100:00100000:2.0:1790784602.231095:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 4 00000100:00100000:2.0:1790784602.231104:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2348:x1877773344942080:12345-192.168.206.32@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790784602.231135:0:14336:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from f4259360-45b3-4521-b0f8-25fb9487baea@192.168.206.32@tcp t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:2.0:1790784602.231183:0:14336:0:(genops.c:1384:class_connect()) connect: client f4259360-45b3-4521-b0f8-25fb9487baea, cookie 0x2c3a1e2a079d4a3b 00000004:00100000:2.0:1790784602.231210:0:14336:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1790784602.231216:0:14336:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1790784602.234655:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790784602.306726:0:14336:0:(import.c:65:import_set_state_nolock()) ffff945802918800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790784602.306804:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4259360-45b3-4521-b0f8-25fb9487baea+6:2348:x1877773344942080:12345-192.168.206.32@tcp:38:mount.lustre.0 Request processed in 75698us (76030us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784602.306815:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 4 00000100:00100000:1.0:1790784602.312735:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784602.312890:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784602.313838:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344942208 00000100:00100000:0.0:1790784602.313913:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344942208 00000100:00100000:0.0:1790784602.314036:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344942336 00000100:00100000:0.0:1790784602.314040:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344942336 00000100:00100000:0.0:1790784602.314058:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 5 00000100:00100000:0.0:1790784602.314066:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592daa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4259360-45b3-4521-b0f8-25fb9487baea+7:0:x1877773344942208:12345-192.168.206.32@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790784602.314270:0:14337:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790784602.314362:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592daa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4259360-45b3-4521-b0f8-25fb9487baea+7:0:x1877773344942208:12345-192.168.206.32@tcp:41:mount.lustre.0 Request processed in 296us (1635us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784602.314369:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 5 00000100:00100000:0.0:1790784602.314407:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 6 00000100:00100000:0.0:1790784602.314415:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592daa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4259360-45b3-4521-b0f8-25fb9487baea+6:13725:x1877773344942336:12345-192.168.206.32@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790784602.314426:0:14337:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790784602.314462:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592daa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4259360-45b3-4521-b0f8-25fb9487baea+6:13725:x1877773344942336:12345-192.168.206.32@tcp:41:mount.lustre.0 Request processed in 48us (1572us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784602.314480:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 6 00000100:00080000:1.0:1790784602.315177:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790784602.317500:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784602.318210:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344942464 00000100:00100000:3.0:1790784602.318219:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344942464 00000100:00100000:3.0:1790784602.318282:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 7 00000100:00100000:3.0:1790784602.318292:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592daa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4259360-45b3-4521-b0f8-25fb9487baea+6:13725:x1877773344942464:12345-192.168.206.32@tcp:40:mount.lustre.0 00000100:00100000:3.0:1790784602.318410:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592daa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4259360-45b3-4521-b0f8-25fb9487baea+6:13725:x1877773344942464:12345-192.168.206.32@tcp:40:mount.lustre.0 Request processed in 83us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784602.318418:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 7 00000100:00100000:3.0:1790784602.323058:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784602.323132:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344942592 00000100:00100000:0.0:1790784602.323142:0:15022:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344942592 00000100:00100000:0.0:1790784602.323190:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 8 00000100:00100000:0.0:1790784602.323199:0:15022:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1877773344942592:12345-192.168.206.32@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790784602.323228:0:15022:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from f4259360-45b3-4521-b0f8-25fb9487baea@192.168.206.32@tcp t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:0.0:1790784602.323255:0:15022:0:(genops.c:1384:class_connect()) connect: client f4259360-45b3-4521-b0f8-25fb9487baea, cookie 0x2c3a1e2a079d4a42 00002000:00100000:0.0:1790784602.323265:0:15022:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f4259360-45b3-4521-b0f8-25fb9487baea/ffff94580291f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790784602.323286:0:15022:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790784602.323724:0:15022:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790784602.323751:0:15022:0:(import.c:65:import_set_state_nolock()) ffff94580291e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790784602.323802:0:15022:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4259360-45b3-4521-b0f8-25fb9487baea+6:2348:x1877773344942592:12345-192.168.206.32@tcp:8:mount.lustre.0 Request processed in 603us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784602.323809:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 8 00000100:00100000:1.0:1790784602.330463:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784602.331137:0:15020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344942720 00000100:00100000:3.0:1790784602.331147:0:15020:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344942720 00000100:00100000:3.0:1790784602.331195:0:15020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 9 00000100:00100000:3.0:1790784602.331203:0:15020:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592daa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1877773344942720:12345-192.168.206.32@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790784602.331231:0:15020:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from f4259360-45b3-4521-b0f8-25fb9487baea@192.168.206.32@tcp t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:3.0:1790784602.331268:0:15020:0:(genops.c:1384:class_connect()) connect: client f4259360-45b3-4521-b0f8-25fb9487baea, cookie 0x2c3a1e2a079d4a49 00002000:00100000:3.0:1790784602.331278:0:15020:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f4259360-45b3-4521-b0f8-25fb9487baea/ffff94593f683000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790784602.331300:0:15020:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790784602.331504:0:15020:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790784602.331536:0:15020:0:(import.c:65:import_set_state_nolock()) ffff94593f686000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790784602.332275:0:15020:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592daa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4259360-45b3-4521-b0f8-25fb9487baea+6:2348:x1877773344942720:12345-192.168.206.32@tcp:8:mount.lustre.0 Request processed in 1068us (1819us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784602.332284:0:15020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 9 00000100:00100000:0.0:1790784602.347422:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784602.347590:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344942848 00000100:00100000:2.0:1790784602.347600:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344942848 00000100:00100000:2.0:1790784602.347657:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 0 00000100:00100000:2.0:1790784602.347667:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4259360-45b3-4521-b0f8-25fb9487baea+6:13725:x1877773344942848:12345-192.168.206.32@tcp:33:mount.lustre.0 00000004:00080000:2.0:1790784602.349583:0:14339:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1830us 00000004:00200000:3.0:1790784602.369976:0:14339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1790784602.371468:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4259360-45b3-4521-b0f8-25fb9487baea+6:13725:x1877773344942848:12345-192.168.206.32@tcp:33:mount.lustre.0 Request processed in 23794us (24046us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784602.371486:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 0 00000100:00100000:1.0:1790784602.540521:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784602.540673:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344942976 00000100:00100000:2.0:1790784602.540689:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344942976 00000100:00100000:2.0:1790784602.540831:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 8 00000100:00100000:2.0:1790784602.540844:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592daa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4259360-45b3-4521-b0f8-25fb9487baea+6:13769:x1877773344942976:12345-192.168.206.32@tcp:101:mkdir.0 00010000:00010000:2.0:1790784602.540864:0:14335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784602.540891:0:14335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4a50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381353da expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784602.540960:0:14335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d4a57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784602.540975:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d4a57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784602.540991:0:14335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d4a57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784602.541037:0:14335:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790784602.541041:0:14335:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790784602.541087:0:14335:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d4a57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784602.541114:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4a50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381353da expref: 8 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784602.541134:0:14335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d4a57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381353da expref: 7 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784602.541162:0:14335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2e00) 00010000:00010000:2.0:1790784602.541166:0:14335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790784602.541170:0:14335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe75a00, rc 0) 00000100:00100000:2.0:1790784602.541244:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592daa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4259360-45b3-4521-b0f8-25fb9487baea+7:13769:x1877773344942976:12345-192.168.206.32@tcp:101:mkdir.0 Request processed in 403us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784602.541252:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 8 00000100:00100000:1.0:1790784602.556939:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790784602.557233:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d9ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359613952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790784602.557326:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784602.558976:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359613952 00000100:00100000:0.0:1790784602.558993:0:15023:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359613952 00000100:00100000:0.0:1790784602.559110:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790784602.559122:0:15023:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592daa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359613952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790784602.559169:0:15023:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790784602.559260:0:15023:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592daa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359613952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (1934us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784602.559269:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1790784602.559294:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790784602.559349:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d9ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359613952:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1790784602.722759:0:6693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f4259360-45b3-4521-b0f8-25fb9487baea 00000100:00100000:1.0:1790784603.067151:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1877773359614464:0@lo:400:kworker.0 00000100:00100000:1.0:1790784603.067221:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784603.067317:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359614208:0@lo:400:kworker.0 00000100:00100000:1.0:1790784603.067320:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359614464 00000100:00100000:1.0:1790784603.067329:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359614464 00000100:00100000:2.0:1790784603.067359:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784603.067408:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790784603.067412:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945907df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1877773359614720:0@lo:400:kworker.0 00000100:00100000:1.0:1790784603.067421:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1877773359614464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784603.067437:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784603.067459:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790784603.067474:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1877773359614464:12345-0@lo:400:kworker.0 Request processed in 57us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784603.067481:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790784603.067498:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359614720 00000100:00100000:1.0:1790784603.067502:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359614720 00000100:00100000:1.0:1790784603.067545:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790784603.067552:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1877773359614720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784603.067594:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359614336:0@lo:400:kworker.0 00000100:00100000:0.0:1790784603.067647:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3282:1877773359614080:0@lo:400:kworker.0 00000100:00100000:2.0:1790784603.067726:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784603.067754:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359614208 00000100:00100000:2.0:1790784603.067758:0:15022:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359614208 00000100:00100000:2.0:1790784603.067783:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359614336 00000100:00100000:2.0:1790784603.067785:0:15022:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359614336 00000100:00100000:2.0:1790784603.068251:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790784603.068262:0:15022:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359614208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784603.068310:0:15022:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359614208:12345-0@lo:400:kworker.0 Request processed in 52us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784603.068316:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790784603.068331:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790784603.068336:0:15022:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3279:x1877773359614336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784603.068359:0:15022:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3279:x1877773359614336:12345-0@lo:400:kworker.0 Request processed in 23us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784603.068394:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790784603.068741:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359614336:0@lo:400:kworker.0 00000100:00100000:2.0:1790784603.068759:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359614208:0@lo:400:kworker.0 00000100:00100000:3.0:1790784603.071939:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790784603.071957:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d346a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359614848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790784603.072020:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790784603.072091:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359614848 00000100:00100000:3.0:1790784603.072098:0:15023:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359614848 00000100:00100000:3.0:1790784603.072147:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790784603.072157:0:15023:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d345c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1877773359614848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790784603.072178:0:15023:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790784603.072228:0:15023:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d345c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1877773359614848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784603.072237:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790784603.072479:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d346a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359614848:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1790784603.075826:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790784603.075835:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790784603.075900:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784603.078526:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359614080 00000100:00100000:2.0:1790784603.078551:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359614080 00000100:00100000:2.0:1790784603.078600:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790784603.078611:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+19:3282:x1877773359614080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784603.078688:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+19:3282:x1877773359614080:12345-0@lo:400:kworker.0 Request processed in 80us (2791us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784603.078696:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790784603.078770:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1877773359614464:0@lo:400:kworker.0 00000100:00100000:2.0:1790784603.078825:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3282:1877773359614080:0@lo:400:kworker.0 00000100:00100000:2.0:1790784603.078835:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945907df4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3282:1877773359614592:0@lo:400:kworker.0 00000100:00100000:2.0:1790784603.078867:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784603.078892:0:14335:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1790784603.078899:0:14335:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1790784603.079034:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359614592 00000100:00100000:2.0:1790784603.079038:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359614592 00000100:00100000:2.0:1790784603.079070:0:14335:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1790784603.079089:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790784603.079096:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1877773359614592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784603.084541:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1877773359614720:12345-0@lo:400:kworker.0 Request processed in 16515us (16630us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784603.084555:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790784603.084615:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945907df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1877773359614720:0@lo:400:kworker.0 00000100:00080000:1.0:1790784603.084663:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790784603.087136:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1877773359614592:12345-0@lo:400:kworker.0 Request processed in 8033us (8260us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784603.087149:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790784603.087459:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945907df4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3282:1877773359614592:0@lo:400:kworker.0 00000001:00100000:3.0:1790784603.148187:0:7614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f4259360-45b3-4521-b0f8-25fb9487baea 00000001:00080000:3.0:1790784603.148207:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1790784603.148238:0:7614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1790784603.258553:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790784604.271489:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784604.271600:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344943104 00000100:00100000:2.0:1790784604.271609:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344943104 00000100:00100000:2.0:1790784604.271678:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 9 00000100:00100000:2.0:1790784604.271702:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4259360-45b3-4521-b0f8-25fb9487baea+7:13821:x1877773344943104:12345-192.168.206.32@tcp:41:lfs.0 00000004:00000024:2.0:1790784604.271743:0:14336:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790784604.271837:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4259360-45b3-4521-b0f8-25fb9487baea+7:13821:x1877773344943104:12345-192.168.206.32@tcp:41:lfs.0 Request processed in 138us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784604.271844:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 9 00000100:00080000:1.0:1790784604.271913:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790784604.276808:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784604.277189:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344943232 00000100:00100000:3.0:1790784604.277198:0:15023:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344943232 00000100:00100000:3.0:1790784604.277336:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 6 00000100:00100000:3.0:1790784604.277348:0:15023:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f4259360-45b3-4521-b0f8-25fb9487baea+5:13821:x1877773344943232:12345-192.168.206.32@tcp:13:lfs.0 00002000:00000024:3.0:1790784604.277421:0:15023:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790784604.277509:0:15023:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f4259360-45b3-4521-b0f8-25fb9487baea+5:13821:x1877773344943232:12345-192.168.206.32@tcp:13:lfs.0 Request processed in 164us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784604.277518:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 6 00010000:00010000:3.0:1790784604.283273:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784604.284672:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784604.284850:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344943360 00000100:00100000:0.0:1790784604.284861:0:15023:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344943360 00000100:00080000:1.0:1790784604.285832:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790784604.285842:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790784604.286077:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 7 00000100:00100000:0.0:1790784604.286095:0:15023:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f4259360-45b3-4521-b0f8-25fb9487baea+5:13821:x1877773344943360:12345-192.168.206.32@tcp:13:lfs.0 00002000:00000024:0.0:1790784604.286153:0:15023:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790784604.286266:0:15023:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f4259360-45b3-4521-b0f8-25fb9487baea+5:13821:x1877773344943360:12345-192.168.206.32@tcp:13:lfs.0 Request processed in 179us (1607us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784604.286274:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 7 00000100:00100000:2.0:1790784604.467904:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784604.468024:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344943488 00000100:00100000:0.0:1790784604.468038:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344943488 00000100:00100000:0.0:1790784604.468116:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 91 00000100:00100000:0.0:1790784604.468127:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9cd6e380-086e-4f8a-8222-c63218e0c889+10:13855:x1877773344943488:12345-192.168.206.32@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790784604.468151:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784604.468175:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94593c1b1400/0x2c3a1e2a079d4a5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x394e0d88381353e1 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784604.468213:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94593c1b1400/0x2c3a1e2a079d4a5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381353e1 expref: 11 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784604.468226:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94593c1b1400/0x2c3a1e2a079d4a5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381353e1 expref: 11 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784604.468258:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b1400, rc 0) 00000100:00100000:0.0:1790784604.468329:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9cd6e380-086e-4f8a-8222-c63218e0c889+11:13855:x1877773344943488:12345-192.168.206.32@tcp:101:mount.lustre.0 Request processed in 204us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784604.468336:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 91 00000100:00100000:1.0:1790784604.473806:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784604.474108:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344943616 00000100:00100000:2.0:1790784604.474125:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344943616 00000100:00100000:2.0:1790784604.474255:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 92 00000100:00100000:2.0:1790784604.474268:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9cd6e380-086e-4f8a-8222-c63218e0c889+11:13855:x1877773344943616:12345-192.168.206.32@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790784604.474759:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9cd6e380-086e-4f8a-8222-c63218e0c889+11:13855:x1877773344943616:12345-192.168.206.32@tcp:501:mount.lustre.0 Request processed in 492us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784604.474769:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 92 00000100:00100000:3.0:1790784604.478491:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784604.481318:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344943744 00000100:00100000:0.0:1790784604.481341:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344943744 00000100:00100000:0.0:1790784604.481483:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 93 00000100:00100000:0.0:1790784604.481496:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9cd6e380-086e-4f8a-8222-c63218e0c889+11:13855:x1877773344943744:12345-192.168.206.32@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790784604.481834:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9cd6e380-086e-4f8a-8222-c63218e0c889+11:13855:x1877773344943744:12345-192.168.206.32@tcp:503:mount.lustre.0 Request processed in 340us (3355us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784604.481844:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 93 00000100:00100000:1.0:1790784604.492652:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784604.493425:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344943872 00000100:00100000:0.0:1790784604.493514:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344943872 00000100:00100000:0.0:1790784604.493592:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 94 00000100:00100000:0.0:1790784604.493606:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9cd6e380-086e-4f8a-8222-c63218e0c889+11:13860:x1877773344943872:12345-192.168.206.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790784604.494261:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9cd6e380-086e-4f8a-8222-c63218e0c889+11:13860:x1877773344943872:12345-192.168.206.32@tcp:502:llog_process_th.0 Request processed in 652us (1616us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784604.494273:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 94 00000100:00100000:3.0:1790784604.509492:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784604.511595:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344944000 00000100:00100000:1.0:1790784604.511610:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344944000 00000100:00100000:1.0:1790784604.511735:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 95 00000100:00100000:1.0:1790784604.511746:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9cd6e380-086e-4f8a-8222-c63218e0c889+11:13860:x1877773344944000:12345-192.168.206.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790784604.512123:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9cd6e380-086e-4f8a-8222-c63218e0c889+11:13860:x1877773344944000:12345-192.168.206.32@tcp:502:llog_process_th.0 Request processed in 377us (2645us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784604.512132:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 95 00000100:00100000:3.0:1790784604.522833:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784604.523137:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344944128 00000100:00100000:0.0:1790784604.523154:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344944128 00000100:00100000:0.0:1790784604.523223:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 96 00000100:00100000:0.0:1790784604.523237:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9cd6e380-086e-4f8a-8222-c63218e0c889+11:13855:x1877773344944128:12345-192.168.206.32@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790784604.523259:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784604.523284:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94593c1b0600/0x2c3a1e2a079d4a65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x394e0d883813540b expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784604.523347:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94593c1b0600/0x2c3a1e2a079d4a65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813540b expref: 12 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784604.523360:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94593c1b0600/0x2c3a1e2a079d4a65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813540b expref: 12 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784604.523371:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b0600, rc 0) 00000100:00100000:0.0:1790784604.523484:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9cd6e380-086e-4f8a-8222-c63218e0c889+12:13855:x1877773344944128:12345-192.168.206.32@tcp:101:mount.lustre.0 Request processed in 246us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784604.523492:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 96 00000100:00100000:3.0:1790784604.528689:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784604.528815:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344944256 00000100:00100000:2.0:1790784604.528831:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344944256 00000100:00100000:2.0:1790784604.528902:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 97 00000100:00100000:2.0:1790784604.528914:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9cd6e380-086e-4f8a-8222-c63218e0c889+12:13855:x1877773344944256:12345-192.168.206.32@tcp:256:mount.lustre.0 20000000:01000000:2.0:1790784604.528938:0:14329:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790784604.528965:0:14329:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790784604.528969:0:14329:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790784604.528972:0:14329:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790784604.528975:0:14329:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1790784604.533680:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9cd6e380-086e-4f8a-8222-c63218e0c889+12:13855:x1877773344944256:12345-192.168.206.32@tcp:256:mount.lustre.0 Request processed in 4758us (5000us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784604.533695:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 97 00000100:00100000:2.0:1790784604.537670:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784604.537831:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344944384 00000100:00100000:0.0:1790784604.537840:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344944384 00000100:00100000:0.0:1790784604.538005:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 98 00000100:00100000:0.0:1790784604.538015:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9cd6e380-086e-4f8a-8222-c63218e0c889+12:13855:x1877773344944384:12345-192.168.206.32@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790784604.538031:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784604.538047:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94593c1b0800/0x2c3a1e2a079d4a6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x394e0d8838135412 expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784604.538085:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94593c1b0800/0x2c3a1e2a079d4a6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135412 expref: 13 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784604.538097:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94593c1b0800/0x2c3a1e2a079d4a6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135412 expref: 13 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784604.538106:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593c1b0800, rc 0) 00000100:00100000:0.0:1790784604.538167:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9cd6e380-086e-4f8a-8222-c63218e0c889+13:13855:x1877773344944384:12345-192.168.206.32@tcp:101:mount.lustre.0 Request processed in 154us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784604.538183:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 98 00000100:00100000:3.0:1790784604.539892:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784604.547484:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344944512 00000100:00100000:1.0:1790784604.547503:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344944512 00000100:00100000:1.0:1790784604.547568:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 99 00000100:00100000:1.0:1790784604.547576:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9cd6e380-086e-4f8a-8222-c63218e0c889+13:13855:x1877773344944512:12345-192.168.206.32@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790784604.551011:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9cd6e380-086e-4f8a-8222-c63218e0c889+13:13855:x1877773344944512:12345-192.168.206.32@tcp:501:mount.lustre.0 Request processed in 3422us (11121us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784604.551028:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 99 00000100:00100000:3.0:1790784604.553294:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784604.553390:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344944640 00000100:00100000:1.0:1790784604.553400:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344944640 00000100:00100000:1.0:1790784604.553446:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 100 00000100:00100000:1.0:1790784604.553469:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9cd6e380-086e-4f8a-8222-c63218e0c889+13:13855:x1877773344944640:12345-192.168.206.32@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790784604.553828:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9cd6e380-086e-4f8a-8222-c63218e0c889+13:13855:x1877773344944640:12345-192.168.206.32@tcp:503:mount.lustre.0 Request processed in 360us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784604.553837:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 100 00000100:00100000:3.0:1790784604.558718:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784604.558818:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344944768 00000100:00100000:2.0:1790784604.558828:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344944768 00000100:00100000:2.0:1790784604.558884:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 101 00000100:00100000:2.0:1790784604.558895:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9cd6e380-086e-4f8a-8222-c63218e0c889+13:13864:x1877773344944768:12345-192.168.206.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790784604.559144:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9cd6e380-086e-4f8a-8222-c63218e0c889+13:13864:x1877773344944768:12345-192.168.206.32@tcp:502:llog_process_th.0 Request processed in 250us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784604.559152:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 101 00000100:00100000:3.0:1790784604.566925:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784604.567046:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344944896 00000100:00100000:0.0:1790784604.567056:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344944896 00000100:00100000:0.0:1790784604.567135:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 102 00000100:00100000:0.0:1790784604.567146:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9cd6e380-086e-4f8a-8222-c63218e0c889+13:13864:x1877773344944896:12345-192.168.206.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790784604.567436:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9cd6e380-086e-4f8a-8222-c63218e0c889+13:13864:x1877773344944896:12345-192.168.206.32@tcp:502:llog_process_th.0 Request processed in 290us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784604.567445:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 102 00000100:00100000:3.0:1790784604.577706:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784604.580053:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344945024 00000100:00100000:1.0:1790784604.580079:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344945024 00000100:00100000:1.0:1790784604.580229:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 10 00000100:00100000:1.0:1790784604.580237:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2348:x1877773344945024:12345-192.168.206.32@tcp:38:mount.lustre.0 00010000:00080000:1.0:1790784604.580265:0:14335:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 26f7a80f-38df-4ba4-8176-3236c76f443f@192.168.206.32@tcp t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:1.0:1790784604.580530:0:14335:0:(genops.c:1384:class_connect()) connect: client 26f7a80f-38df-4ba4-8176-3236c76f443f, cookie 0x2c3a1e2a079d4a73 00000004:00100000:1.0:1790784604.580560:0:14335:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1790784604.580677:0:14335:0:(import.c:65:import_set_state_nolock()) ffff945926c96000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790784604.582005:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26f7a80f-38df-4ba4-8176-3236c76f443f+6:2348:x1877773344945024:12345-192.168.206.32@tcp:38:mount.lustre.0 Request processed in 1760us (4301us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784604.582016:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 10 00000100:00100000:2.0:1790784604.590022:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784604.590214:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784604.590252:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784604.590297:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344945664 00000100:00100000:2.0:1790784604.590306:0:15021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344945664 00000100:00100000:2.0:1790784604.590351:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344945536 00000100:00100000:2.0:1790784604.590354:0:15021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344945536 00000100:00100000:2.0:1790784604.590370:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 4 00000100:00100000:2.0:1790784604.590396:0:15021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4259360-45b3-4521-b0f8-25fb9487baea+5:2350:x1877773344945664:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1790784604.590467:0:15021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4259360-45b3-4521-b0f8-25fb9487baea+5:2350:x1877773344945664:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 73us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784604.590474:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 4 00000100:00100000:2.0:1790784604.590493:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 5 00000100:00100000:2.0:1790784604.590500:0:15021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4259360-45b3-4521-b0f8-25fb9487baea+5:2350:x1877773344945536:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1790784604.590526:0:15021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4259360-45b3-4521-b0f8-25fb9487baea+5:2350:x1877773344945536:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 26us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784604.590532:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 5 00000100:00100000:0.0:1790784604.591750:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344945408 00000100:00100000:0.0:1790784604.591760:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344945408 00000100:00100000:0.0:1790784604.591834:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 14 00000100:00100000:0.0:1790784604.591843:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4259360-45b3-4521-b0f8-25fb9487baea+7:2350:x1877773344945408:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:0.0:1790784604.591895:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4259360-45b3-4521-b0f8-25fb9487baea+7:2350:x1877773344945408:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 53us (1881us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784604.592027:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 14 00000100:00100000:2.0:1790784604.613793:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784604.613908:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784604.614131:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344945280 00000100:00100000:3.0:1790784604.614149:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344945280 00000100:00100000:3.0:1790784604.614249:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344945152 00000100:00100000:3.0:1790784604.614253:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344945152 00000100:00100000:3.0:1790784604.614289:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 11 00000100:00100000:1.0:1790784604.614320:0:16214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 12 00000100:00100000:3.0:1790784604.614321:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26f7a80f-38df-4ba4-8176-3236c76f443f+7:13855:x1877773344945280:12345-192.168.206.32@tcp:41:mount.lustre.0 00000100:00100000:1.0:1790784604.614349:0:16214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26f7a80f-38df-4ba4-8176-3236c76f443f+7:0:x1877773344945152:12345-192.168.206.32@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790784604.614369:0:14335:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000004:00000024:1.0:1790784604.614418:0:16214:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:0.0:1790784604.614539:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790784604.615193:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26f7a80f-38df-4ba4-8176-3236c76f443f+7:13855:x1877773344945280:12345-192.168.206.32@tcp:41:mount.lustre.0 Request processed in 877us (1405us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784604.615203:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 11 00000100:00100000:1.0:1790784604.618602:0:16214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26f7a80f-38df-4ba4-8176-3236c76f443f+6:0:x1877773344945152:12345-192.168.206.32@tcp:41:mount.lustre.0 Request processed in 4254us (4690us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784604.618616:0:16214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 12 00000100:00100000:2.0:1790784604.620338:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784604.620470:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344945792 00000100:00100000:3.0:1790784604.620480:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344945792 00000100:00100000:3.0:1790784604.620536:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 13 00000100:00100000:3.0:1790784604.620546:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26f7a80f-38df-4ba4-8176-3236c76f443f+6:13855:x1877773344945792:12345-192.168.206.32@tcp:40:mount.lustre.0 00000100:00100000:3.0:1790784604.620619:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26f7a80f-38df-4ba4-8176-3236c76f443f+6:13855:x1877773344945792:12345-192.168.206.32@tcp:40:mount.lustre.0 Request processed in 75us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784604.620628:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 13 00000100:00100000:2.0:1790784604.628161:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784604.628206:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784604.628240:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784604.628319:0:15020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344945920 00000100:00100000:3.0:1790784604.628328:0:15020:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344945920 00000100:00100000:3.0:1790784604.628365:0:15020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344946048 00000100:00100000:3.0:1790784604.628369:0:15020:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344946048 00000100:00100000:3.0:1790784604.628409:0:15020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 10 00000100:00100000:3.0:1790784604.628418:0:15020:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1877773344945920:12345-192.168.206.32@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790784604.628448:0:15020:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 26f7a80f-38df-4ba4-8176-3236c76f443f@192.168.206.32@tcp t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:3.0:1790784604.628477:0:15020:0:(genops.c:1384:class_connect()) connect: client 26f7a80f-38df-4ba4-8176-3236c76f443f, cookie 0x2c3a1e2a079d4a7a 00002000:00100000:3.0:1790784604.628488:0:15020:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 26f7a80f-38df-4ba4-8176-3236c76f443f/ffff94593f684800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790784604.628499:0:15020:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790784604.628778:0:15020:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790784604.628808:0:15020:0:(import.c:65:import_set_state_nolock()) ffff94593f680000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790784604.628867:0:15020:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26f7a80f-38df-4ba4-8176-3236c76f443f+6:2348:x1877773344945920:12345-192.168.206.32@tcp:8:mount.lustre.0 Request processed in 450us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784604.628890:0:15020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 10 00000100:00100000:3.0:1790784604.628925:0:15020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 11 00000100:00100000:3.0:1790784604.628930:0:15020:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1877773344946048:12345-192.168.206.32@tcp:8:mount.lustre.0 00010000:00080000:3.0:1790784604.628947:0:15020:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 26f7a80f-38df-4ba4-8176-3236c76f443f@192.168.206.32@tcp t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:3.0:1790784604.628962:0:15020:0:(genops.c:1384:class_connect()) connect: client 26f7a80f-38df-4ba4-8176-3236c76f443f, cookie 0x2c3a1e2a079d4a81 00002000:00100000:3.0:1790784604.628968:0:15020:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 26f7a80f-38df-4ba4-8176-3236c76f443f/ffff94593f682800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790784604.628973:0:15020:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1790784604.629111:0:15020:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790784604.629126:0:15020:0:(import.c:65:import_set_state_nolock()) ffff94593f687000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790784604.629148:0:15020:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26f7a80f-38df-4ba4-8176-3236c76f443f+6:2348:x1877773344946048:12345-192.168.206.32@tcp:8:mount.lustre.0 Request processed in 216us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784604.629155:0:15020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 11 00000100:00100000:1.0:1790784604.629476:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344946176 00000100:00100000:1.0:1790784604.629489:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344946176 00000100:00100000:1.0:1790784604.629573:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 1 00000100:00100000:1.0:1790784604.629584:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26f7a80f-38df-4ba4-8176-3236c76f443f+6:13855:x1877773344946176:12345-192.168.206.32@tcp:33:mount.lustre.0 00000004:00200000:1.0:1790784604.629694:0:14338:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1790784604.629789:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26f7a80f-38df-4ba4-8176-3236c76f443f+6:13855:x1877773344946176:12345-192.168.206.32@tcp:33:mount.lustre.0 Request processed in 207us (1547us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784604.629797:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 1 00000040:00080000:2.0:1790784604.859188:0:14368:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790784604.878627:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784604.878879:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344946304 00000100:00100000:0.0:1790784604.878889:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344946304 00000100:00100000:0.0:1790784604.878948:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 14 00000100:00100000:0.0:1790784604.878958:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26f7a80f-38df-4ba4-8176-3236c76f443f+6:13885:x1877773344946304:12345-192.168.206.32@tcp:101:mkdir.0 00010000:00010000:0.0:1790784604.878977:0:14336:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784604.879000:0:14336:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4a88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813543c expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784604.879072:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945909574e00/0x2c3a1e2a079d4a8f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784604.879097:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945909574e00/0x2c3a1e2a079d4a8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784604.879112:0:14336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945909574e00/0x2c3a1e2a079d4a8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790784604.879147:0:14336:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790784604.879151:0:14336:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790784604.879170:0:14336:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945909574e00/0x2c3a1e2a079d4a8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784604.879194:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593c1b0200/0x2c3a1e2a079d4a88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813543c expref: 8 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784604.879211:0:14336:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945909574e00/0x2c3a1e2a079d4a8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813543c expref: 7 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784604.879219:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2e00) 00010000:00010000:0.0:1790784604.879222:0:14336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790784604.879226:0:14336:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945909574e00, rc 0) 00000100:00100000:0.0:1790784604.879285:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26f7a80f-38df-4ba4-8176-3236c76f443f+7:13885:x1877773344946304:12345-192.168.206.32@tcp:101:mkdir.0 Request processed in 328us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784604.879292:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 14 00010000:00010000:2.0:1790784605.306751:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790784606.331860:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784607.354619:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784607.674662:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359614976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790784607.674780:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784607.674923:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359614976 00000100:00100000:2.0:1790784607.674930:0:15024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359614976 00000100:00100000:2.0:1790784607.675338:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790784607.675348:0:15024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359614976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790784607.675415:0:15024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790784607.675466:0:15024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359614976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784607.675472:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790784607.676005:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359614976:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790784607.677580:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1790784607.736739:0:5841:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f4259360-45b3-4521-b0f8-25fb9487baea 00000001:00100000:1.0:1790784607.736763:0:5841:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 26f7a80f-38df-4ba4-8176-3236c76f443f 00000001:00100000:3.0:1790784607.740505:0:6693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 26f7a80f-38df-4ba4-8176-3236c76f443f 00000001:02000400:3.0:1790784608.159517:0:16303:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1790784608.187666:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945907df5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359615232:0@lo:400:kworker.0 00000100:00100000:1.0:1790784608.187734:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784608.187786:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945907df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1877773359615744:0@lo:400:kworker.0 00000100:00100000:1.0:1790784608.187810:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784608.187857:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790784608.187864:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945907df5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359615360:0@lo:400:kworker.0 00000100:00100000:1.0:1790784608.187901:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784608.187931:0:15020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359615232 00000100:00100000:1.0:1790784608.187937:0:15020:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359615232 00000100:00100000:1.0:1790784608.187977:0:15020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359615360 00000100:00100000:1.0:1790784608.187980:0:15020:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359615360 00000100:00100000:1.0:1790784608.188007:0:15020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790784608.188015:0:15020:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359615232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784608.188077:0:15020:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359615232:12345-0@lo:400:kworker.0 Request processed in 62us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784608.188084:0:15020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790784608.188100:0:15020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790784608.188106:0:15020:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359615360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784608.188135:0:15020:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359615360:12345-0@lo:400:kworker.0 Request processed in 29us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784608.188156:0:15020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790784608.188174:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359615744 00000100:00100000:1.0:1790784608.188177:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359615744 00000100:00100000:1.0:1790784608.188219:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790784608.188226:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1877773359615744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784608.188258:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1877773359615744:12345-0@lo:400:kworker.0 Request processed in 33us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784608.188265:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1790784608.188964:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790784608.188970:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790784608.189001:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1790784608.189019:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945907df5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359615360:0@lo:400:kworker.0 00000100:00100000:1.0:1790784608.189031:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945907df5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359615232:0@lo:400:kworker.0 00000100:00100000:1.0:1790784608.189039:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945907df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3279:1877773359615744:0@lo:400:kworker.0 00000100:00100000:1.0:1790784608.190841:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790784608.190860:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945907df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359615872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790784608.190938:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784608.191856:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945907df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3282:1877773359615104:0@lo:400:kworker.0 00000100:00100000:2.0:1790784608.192224:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784608.192263:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945907df6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3282:1877773359615616:0@lo:400:kworker.0 00000100:00100000:2.0:1790784608.192291:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784608.192315:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790784608.192321:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945907df7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1877773359615488:0@lo:400:kworker.0 00000100:00100000:2.0:1790784608.192342:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784608.192566:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359615616 00000100:00100000:0.0:1790784608.192583:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359615616 00000100:00100000:0.0:1790784608.192634:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359615488 00000100:00100000:0.0:1790784608.192638:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359615488 00000100:00100000:0.0:1790784608.192658:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790784608.192667:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592daa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1877773359615616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784608.192718:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592daa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1877773359615616:12345-0@lo:400:kworker.0 Request processed in 52us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784608.192725:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790784608.192742:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790784608.192748:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592daa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1877773359615488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784608.192775:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592daa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1877773359615488:12345-0@lo:400:kworker.0 Request processed in 27us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784608.192780:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790784608.197848:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359615872 00000100:00100000:1.0:1790784608.197864:0:15024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359615872 00000100:00100000:1.0:1790784608.197986:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790784608.197998:0:15024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359615872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790784608.198058:0:15024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790784608.198148:0:15024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359615872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (7208us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784608.198155:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1790784608.198200:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790784608.198246:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945907df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359615872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790784608.199698:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359615104 00000100:00100000:3.0:1790784608.199711:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359615104 00000100:00100000:3.0:1790784608.199772:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790784608.199782:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+19:3282:x1877773359615104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784608.199851:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+19:3282:x1877773359615104:12345-0@lo:400:kworker.0 Request processed in 71us (7627us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784608.199857:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790784608.209536:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945907df7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3282:1877773359615488:0@lo:400:kworker.0 00000100:00100000:2.0:1790784608.209554:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945907df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3282:1877773359615104:0@lo:400:kworker.0 00000100:00100000:2.0:1790784608.209565:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945907df6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3282:1877773359615616:0@lo:400:kworker.0 00000001:00100000:3.0:1790784608.308331:0:7614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 26f7a80f-38df-4ba4-8176-3236c76f443f 00010000:00010000:3.0:1790784608.381299:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784609.409245:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784609.711844:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784609.711962:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784609.711999:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784609.712020:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784609.712052:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784609.712076:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784609.712101:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784609.712692:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344946688 00000100:00100000:3.0:1790784609.712839:0:15020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344947200 00000100:00100000:3.0:1790784609.712850:0:15020:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344947200 00000100:00100000:3.0:1790784609.712929:0:15020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344946816 00000100:00100000:3.0:1790784609.712932:0:15020:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344946816 00000100:00100000:3.0:1790784609.712948:0:15020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344947072 00000100:00100000:3.0:1790784609.712950:0:15020:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344947072 00000100:00100000:3.0:1790784609.712973:0:15020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 8 00000100:00100000:3.0:1790784609.712985:0:15020:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26f7a80f-38df-4ba4-8176-3236c76f443f+5:2349:x1877773344947200:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1790784609.713091:0:15020:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26f7a80f-38df-4ba4-8176-3236c76f443f+5:2349:x1877773344947200:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 108us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784609.713100:0:15020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 8 00000100:00100000:3.0:1790784609.713119:0:15020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 9 00000100:00100000:3.0:1790784609.713126:0:15020:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4259360-45b3-4521-b0f8-25fb9487baea+5:2349:x1877773344946816:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1790784609.713150:0:15020:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4259360-45b3-4521-b0f8-25fb9487baea+5:2349:x1877773344946816:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 25us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784609.713156:0:15020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 9 00000100:00100000:3.0:1790784609.713166:0:15020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 10 00000100:00100000:3.0:1790784609.713172:0:15020:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26f7a80f-38df-4ba4-8176-3236c76f443f+5:2349:x1877773344947072:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1790784609.713193:0:15020:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26f7a80f-38df-4ba4-8176-3236c76f443f+5:2349:x1877773344947072:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 22us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784609.713199:0:15020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 10 00000100:00080000:3.0:1790784609.713431:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790784609.713436:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790784609.713807:0:15022:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344946688 00000100:00100000:1.0:1790784609.713862:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 11 00000100:00100000:1.0:1790784609.713870:0:15022:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4259360-45b3-4521-b0f8-25fb9487baea+5:2349:x1877773344946688:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784609.714051:0:15022:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4259360-45b3-4521-b0f8-25fb9487baea+5:2349:x1877773344946688:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 180us (2087us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784609.714059:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 11 00000100:00100000:1.0:1790784609.714087:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344946944 00000100:00100000:1.0:1790784609.714092:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344946944 00000100:00100000:1.0:1790784609.714120:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344946560 00000100:00100000:1.0:1790784609.714123:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344946560 00000100:00100000:1.0:1790784609.714144:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 18 00000100:00100000:1.0:1790784609.714150:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26f7a80f-38df-4ba4-8176-3236c76f443f+6:2349:x1877773344946944:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784609.714179:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26f7a80f-38df-4ba4-8176-3236c76f443f+6:2349:x1877773344946944:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 30us (2181us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784609.714186:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 18 00000100:00100000:1.0:1790784609.714197:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 19 00000100:00100000:1.0:1790784609.714203:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4259360-45b3-4521-b0f8-25fb9487baea+6:2349:x1877773344946560:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784609.714225:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4259360-45b3-4521-b0f8-25fb9487baea+6:2349:x1877773344946560:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 22us (2173us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784609.714231:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 19 00000100:00080000:3.0:1790784609.715201:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790784609.715212:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790784609.717791:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344946432 00000100:00100000:2.0:1790784609.717810:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344946432 00000100:00100000:2.0:1790784609.717883:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 104 00000100:00100000:2.0:1790784609.717895:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9cd6e380-086e-4f8a-8222-c63218e0c889+13:2349:x1877773344946432:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1790784609.718007:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9cd6e380-086e-4f8a-8222-c63218e0c889+13:2349:x1877773344946432:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 114us (6180us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784609.718015:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 104 00010000:00010000:3.0:1790784610.426537:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784611.450600:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790784611.732112:0:16453:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe0ed9d3d0 20000000:00000080:2.0:1790784611.732130:0:16453:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff945803471c00 uarg=0000000000000000 20000000:01000000:2.0:1790784611.732162:0:16453:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790784611.732168:0:16453:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790784611.732173:0:16453:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1790784611.733356:0:16454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1790784611.733617:0:16453:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1790784611.738845:0:16453:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790784611.738924:0:16453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94593fe75000/0x2c3a1e2a079d4a96 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.738943:0:16453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff945900030800/0x2c3a1e2a079d478d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d4786 expref: 18 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.738952:0:16453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94593fe74800/0x2c3a1e2a079d47da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d47d3 expref: 18 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.738960:0:16453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94590955ee00/0x2c3a1e2a079d4915 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d490e expref: 18 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.738969:0:16453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94593fe74600/0x2c3a1e2a079d4a34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381353b0 expref: 12 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.738994:0:16453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94593c1b0800/0x2c3a1e2a079d4a6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135412 expref: 12 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.739001:0:16453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94593fe75000/0x2c3a1e2a079d4a96 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.739051:0:16453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94593c1b0800/0x2c3a1e2a079d4a6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135412 expref: 12 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.739073:0:16453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94593c1b0800/0x2c3a1e2a079d4a6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135412 expref: 12 pid: 14328 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784611.739088:0:16453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16453:1877773359616000:192.168.206.32@tcp:104: 00010000:00010000:2.0:1790784611.739236:0:16453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94593fe74600/0x2c3a1e2a079d4a34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381353b0 expref: 12 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.739245:0:16453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94593fe74600/0x2c3a1e2a079d4a34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381353b0 expref: 12 pid: 14330 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784611.739253:0:16453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592daa2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16453:1877773359616128:192.168.206.32@tcp:104: 00010000:00010000:2.0:1790784611.739280:0:16453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94590955ee00/0x2c3a1e2a079d4915 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d490e expref: 18 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.739288:0:16453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94590955ee00/0x2c3a1e2a079d4915 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d490e expref: 18 pid: 14328 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784611.739296:0:16453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590685f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16453:1877773359616256:0@lo:104: 00000100:00100000:2.0:1790784611.739326:0:16453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790784611.739366:0:16453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94593fe74800/0x2c3a1e2a079d47da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d47d3 expref: 18 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.739393:0:16453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94593fe74800/0x2c3a1e2a079d47da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d47d3 expref: 18 pid: 14330 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784611.739402:0:16453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590685d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16453:1877773359616384:0@lo:104: 00000100:00100000:2.0:1790784611.739420:0:16453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784611.739445:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359616256 00000100:00100000:2.0:1790784611.739451:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359616256 00000100:00100000:2.0:1790784611.739482:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359616384 00000100:00100000:2.0:1790784611.739484:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359616384 00000100:00100000:2.0:1790784611.739496:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790784611.739503:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590685f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+4:16453:x1877773359616256:12345-0@lo:104: 00010000:00010000:2.0:1790784611.739514:0:14319:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff94593c1b1600/0x2c3a1e2a079d490e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d4915 expref: -99 pid: 15738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.739553:0:14319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790784611.739558:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590685f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+4:16453:x1877773359616256:12345-0@lo:104: Request processed in 56us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784611.739564:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790784611.739582:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790784611.739587:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590685f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+3:16453:x1877773359616384:12345-0@lo:104: 00010000:00010000:2.0:1790784611.739594:0:14319:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff945802d2e400/0x2c3a1e2a079d47d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d47da expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.739619:0:14319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790784611.739624:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590685f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+3:16453:x1877773359616384:12345-0@lo:104: Request processed in 37us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784611.739637:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1790784611.739652:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790784611.739658:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff94593c1b1600/0x2c3a1e2a079d490e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d4915 expref: -99 pid: 15738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.739665:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b1600 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:2.0:1790784611.739670:0:14323:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff94593c1b1600/0x2c3a1e2a079d490e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d4915 expref: -99 pid: 15738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.739678:0:14323:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff94593c1b1600/0x2c3a1e2a079d490e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d4915 expref: -99 pid: 15738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790784611.739685:0:14323:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff94593c1b1600/0x2c3a1e2a079d490e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d4915 expref: -99 pid: 15738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790784611.739690:0:14323:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790784611.739713:0:14323:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff94593c1b1600/0x2c3a1e2a079d490e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d4915 expref: -99 pid: 15738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.739719:0:14323:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790784611.739736:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff94593c1b1600/0x2c3a1e2a079d490e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d4915 expref: -99 pid: 15738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.739742:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff94593c1b1600/0x2c3a1e2a079d490e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d4915 expref: -99 pid: 15738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.739756:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790784611.739759:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff945802d2e400/0x2c3a1e2a079d47d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d47da expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.739773:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2e400 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:2.0:1790784611.739776:0:14323:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff945802d2e400/0x2c3a1e2a079d47d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d47da expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.739782:0:14323:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff945802d2e400/0x2c3a1e2a079d47d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d47da expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790784611.739787:0:14323:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff945802d2e400/0x2c3a1e2a079d47d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d47da expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790784611.739792:0:14323:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790784611.739805:0:14323:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff945802d2e400/0x2c3a1e2a079d47d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d47da expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.739810:0:14323:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790784611.739816:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff945802d2e400/0x2c3a1e2a079d47d3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d47da expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.739822:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff945802d2e400/0x2c3a1e2a079d47d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d47da expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.739830:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784611.739831:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784611.739833:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784611.739850:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590685ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3282:1877773359616640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790784611.739877:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784611.739904:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790784611.739909:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590685dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3282:1877773359616512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790784611.739940:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790784611.739972:0:16453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff945900030800/0x2c3a1e2a079d478d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2c3a1e2a079d4786 expref: 18 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.739981:0:16453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff945900030800/0x2c3a1e2a079d478d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2c3a1e2a079d4786 expref: 18 pid: 14328 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784611.739989:0:16453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590685d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16453:1877773359616768:0@lo:104: 00000100:00100000:2.0:1790784611.740011:0:16453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784611.740048:0:14319:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790784611.740056:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359616768 00000100:00100000:2.0:1790784611.740060:0:14319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359616768 00000100:00100000:2.0:1790784611.740076:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790784611.740081:0:14319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590510d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+3:16453:x1877773359616768:12345-0@lo:104: 00010000:00010000:2.0:1790784611.740089:0:14319:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.132@tcp lock: ffff94593c1b0400/0x2c3a1e2a079d4786 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d478d expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.740119:0:14319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790784611.740124:0:14319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590510d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+3:16453:x1877773359616768:12345-0@lo:104: Request processed in 43us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784611.740130:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1790784611.740160:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790784611.740164:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.132@tcp lock: ffff94593c1b0400/0x2c3a1e2a079d4786 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2c3a1e2a079d478d expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.740170:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593c1b0400 already unused, calling callback (ffffffffc1bf9c20) 10000000:00010000:2.0:1790784611.740174:0:14323:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.132@tcp lock: ffff94593c1b0400/0x2c3a1e2a079d4786 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2c3a1e2a079d478d expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.740191:0:14323:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.132@tcp lock: ffff94593c1b0400/0x2c3a1e2a079d4786 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2c3a1e2a079d478d expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790784611.740197:0:14323:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.132@tcp lock: ffff94593c1b0400/0x2c3a1e2a079d4786 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2c3a1e2a079d478d expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790784611.740203:0:14323:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790784611.740218:0:14323:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.132@tcp lock: ffff94593c1b0400/0x2c3a1e2a079d4786 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d478d expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.740224:0:14323:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790784611.740255:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.132@tcp lock: ffff94593c1b0400/0x2c3a1e2a079d4786 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d478d expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.740262:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.132@tcp lock: ffff94593c1b0400/0x2c3a1e2a079d4786 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2c3a1e2a079d478d expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.740275:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784611.740276:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784611.740278:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784611.740291:0:16453:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910ac7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790784611.740308:0:16453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590685f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16453:1877773359616256:0@lo:104: 00000100:00100000:2.0:1790784611.740315:0:16453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590685d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16453:1877773359616384:0@lo:104: 00000100:00100000:2.0:1790784611.740321:0:16453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590685d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16453:1877773359616768:0@lo:104: 00000100:00100000:0.0:1790784611.740412:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359616640 00000100:00100000:0.0:1790784611.740416:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359616640 00010000:00010000:0.0:1790784611.740435:0:14322:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94593fe74800/0x2c3a1e2a079d47da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d47d3 expref: 19 pid: 14330 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784611.740455:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359616512 00000100:00100000:0.0:1790784611.740457:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359616512 00010000:00010000:0.0:1790784611.740465:0:14322:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94590955ee00/0x2c3a1e2a079d4915 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d490e expref: 20 pid: 14328 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784611.740486:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790784611.740491:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590685ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+20:3282:x1877773359616640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790784611.740500:0:14322:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784611.740505:0:14322:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94593fe74800/0x2c3a1e2a079d47da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d47d3 expref: 20 pid: 14330 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784611.740514:0:14322:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94593fe74800/0x2c3a1e2a079d47da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d47d3 expref: 20 pid: 14330 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784611.740526:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94593fe74800/0x2c3a1e2a079d47da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d47d3 expref: 20 pid: 14330 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784611.740537:0:14322:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790784611.740565:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590685ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+19:3282:x1877773359616640:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784611.740571:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790784611.740584:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790784611.740590:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590685df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+18:3282:x1877773359616512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790784611.740597:0:14322:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784611.740601:0:14322:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94590955ee00/0x2c3a1e2a079d4915 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d490e expref: 18 pid: 14328 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784611.740609:0:14322:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94590955ee00/0x2c3a1e2a079d4915 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d490e expref: 18 pid: 14328 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784611.740619:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94590955ee00/0x2c3a1e2a079d4915 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d490e expref: 18 pid: 14328 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784611.740638:0:14322:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790784611.740660:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590685df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+17:3282:x1877773359616512:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784611.740665:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790784611.740684:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790784611.740692:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590685f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3280:1877773359616896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790784611.740717:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784611.740745:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590685dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3282:1877773359616512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790784611.740753:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590685ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3282:1877773359616640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790784611.740775:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359616896 00000100:00100000:0.0:1790784611.740778:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359616896 00010000:00010000:0.0:1790784611.740789:0:14322:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff945900030800/0x2c3a1e2a079d478d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d4786 expref: 17 pid: 14328 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784611.740805:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790784611.740811:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c28ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+17:3280:x1877773359616896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790784611.740818:0:14322:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784611.740822:0:14322:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff945900030800/0x2c3a1e2a079d478d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2c3a1e2a079d4786 expref: 17 pid: 14328 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784611.740829:0:14322:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff945900030800/0x2c3a1e2a079d478d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2c3a1e2a079d4786 expref: 17 pid: 14328 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784611.740838:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff945900030800/0x2c3a1e2a079d478d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2c3a1e2a079d4786 expref: 17 pid: 14328 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784611.740846:0:14322:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790784611.740878:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c28ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+16:3280:x1877773359616896:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784611.740885:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790784611.740921:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590685f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3280:1877773359616896:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790784611.741536:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784611.745229:0:16453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16453:1877773359616000:192.168.206.32@tcp:104: 00000100:00100000:2.0:1790784611.745249:0:16453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592daa2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16453:1877773359616128:192.168.206.32@tcp:104: 00010000:00010000:2.0:1790784611.745311:0:16453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94593fe75000/0x2c3a1e2a079d4a96 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784611.753839:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784611.753924:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344947328 00000100:00100000:0.0:1790784611.753940:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344947328 00010000:00010000:0.0:1790784611.753988:0:14322:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94593fe74600/0x2c3a1e2a079d4a34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381353b0 expref: 13 pid: 14330 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784611.754093:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 7 00000100:00100000:0.0:1790784611.754104:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590685d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9cd6e380-086e-4f8a-8222-c63218e0c889+13:2352:x1877773344947328:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790784611.754120:0:14322:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784611.754126:0:14322:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94593fe74600/0x2c3a1e2a079d4a34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381353b0 expref: 13 pid: 14330 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784611.754138:0:14322:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94593fe74600/0x2c3a1e2a079d4a34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381353b0 expref: 13 pid: 14330 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784611.754156:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94593fe74600/0x2c3a1e2a079d4a34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381353b0 expref: 13 pid: 14330 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784611.754172:0:14322:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790784611.754230:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590685d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9cd6e380-086e-4f8a-8222-c63218e0c889+12:2352:x1877773344947328:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 128us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784611.754237:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 7 00000100:00100000:3.0:1790784611.755915:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784611.757341:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344947456 00000100:00100000:2.0:1790784611.757355:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344947456 00010000:00010000:2.0:1790784611.757423:0:14320:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94593c1b0800/0x2c3a1e2a079d4a6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135412 expref: 12 pid: 14328 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784611.757467:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 8 00000100:00100000:2.0:1790784611.757478:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9cd6e380-086e-4f8a-8222-c63218e0c889+12:2351:x1877773344947456:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790784611.757494:0:14320:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784611.757500:0:14320:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94593c1b0800/0x2c3a1e2a079d4a6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135412 expref: 12 pid: 14328 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.757516:0:14320:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94593c1b0800/0x2c3a1e2a079d4a6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135412 expref: 12 pid: 14328 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.757534:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94593c1b0800/0x2c3a1e2a079d4a6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135412 expref: 12 pid: 14328 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.757550:0:14320:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94593fe75000/0x2c3a1e2a079d4a96 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.757559:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94593fe75000/0x2c3a1e2a079d4a96 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.757578:0:14320:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94593fe75000/0x2c3a1e2a079d4a96 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.757585:0:14320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94593fe75000/0x2c3a1e2a079d4a96 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.757607:0:14320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94593fe75000/0x2c3a1e2a079d4a96 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.757613:0:14320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94593fe75000/0x2c3a1e2a079d4a96 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.757619:0:14320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75000 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:2.0:1790784611.757623:0:14320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94593fe75000/0x2c3a1e2a079d4a96 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.757631:0:14320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94593fe75000/0x2c3a1e2a079d4a96 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.757652:0:14320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94593fe75000/0x2c3a1e2a079d4a96 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784611.757662:0:14320:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790784611.757738:0:16453:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94593fe75000/0x2c3a1e2a079d4a96 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784611.757738:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9cd6e380-086e-4f8a-8222-c63218e0c889+11:2351:x1877773344947456:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 255us (1826us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784611.757771:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 8 00010000:00010000:3.0:1790784611.757773:0:16453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94593fe75000/0x2c3a1e2a079d4a96 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784611.757785:0:16453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94593fe75000/0x2c3a1e2a079d4a96 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784612.474616:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790784612.795291:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790784612.795320:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945907df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359617024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790784612.795437:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784612.795964:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359617024 00000100:00100000:0.0:1790784612.795975:0:15024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359617024 00000100:00100000:0.0:1790784612.796079:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790784612.796091:0:15024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359617024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790784612.796149:0:15024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790784612.796211:0:15024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359617024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784612.796219:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1790784612.796286:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790784612.796518:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945907df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359617024:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1790784613.178543:0:14333:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790784613.178553:0:14333:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff945926dbf800 from 10 10000000:01000000:2.0:1790784613.178561:0:14333:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790784613.178627:0:14333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff94593fe74600/0x2c3a1e2a079d4a9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784613.178642:0:14333:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff94593fe74600/0x2c3a1e2a079d4a9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784613.178656:0:14333:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff94593fe74600/0x2c3a1e2a079d4a9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784613.178700:0:14333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590685d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359617152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790784613.178790:0:14333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784613.178862:0:14333:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910ac79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790784613.180793:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359617152 00000100:00100000:1.0:1790784613.180813:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359617152 00000100:00100000:1.0:1790784613.180895:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790784613.180907:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+16:14333:x1877773359617152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790784613.180929:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784613.180953:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94590955f800/0x2c3a1e2a079d4aa4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d4a9d expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784613.180988:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94590955f800/0x2c3a1e2a079d4aa4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d4a9d expref: 17 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784613.181000:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94590955f800/0x2c3a1e2a079d4aa4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d4a9d expref: 17 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784613.181010:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94590955f800, rc 0) 00000100:00100000:1.0:1790784613.181118:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+17:14333:x1877773359617152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 213us (2328us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784613.181126:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790784613.181428:0:14333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590685d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359617152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790784613.181450:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff94593fe74600/0x2c3a1e2a079d4a9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4aa4 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784613.181460:0:14333:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff94593fe74600/0x2c3a1e2a079d4a9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d4aa4 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784613.181563:0:14333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590685d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359617280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790784613.181604:0:14333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784613.181642:0:14333:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910ac79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790784613.181941:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359617280 00000100:00100000:1.0:1790784613.181947:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359617280 00000100:00100000:1.0:1790784613.181979:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790784613.181987:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593d72c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+17:14333:x1877773359617280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790784613.182589:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593d72c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+17:14333:x1877773359617280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 600us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784613.182610:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790784613.182726:0:14333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590685d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359617280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790784613.182777:0:14333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590685d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359617408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790784613.182830:0:14333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784613.182871:0:14333:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910ac79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790784613.183492:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359617408 00000100:00100000:1.0:1790784613.183573:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359617408 00000100:00100000:1.0:1790784613.183631:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790784613.183640:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+17:14333:x1877773359617408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790784613.183867:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+17:14333:x1877773359617408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 228us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784613.183876:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790784613.183929:0:14333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590685d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359617408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790784613.191911:0:16508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1790784613.196807:0:14333:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1790784613.196857:0:14333:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790784613.196872:0:14333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff94593fe74600/0x2c3a1e2a079d4a9d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4aa4 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784613.196888:0:14333:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff94593fe74600/0x2c3a1e2a079d4a9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4aa4 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790784613.196900:0:14333:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790784613.196903:0:14333:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff945935d6d800 from 10 10000000:01000000:1.0:1790784613.196906:0:14333:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790784613.196958:0:14333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff94590955e000/0x2c3a1e2a079d4aab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784613.196968:0:14333:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff94590955e000/0x2c3a1e2a079d4aab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784613.196980:0:14333:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff94590955e000/0x2c3a1e2a079d4aab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784613.197013:0:14333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945907df6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359617536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790784613.197118:0:14333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784613.197194:0:14333:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592d92b480 going to sleep for 11 seconds 00000100:00100000:0.0:1790784613.197510:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359617536 00000100:00100000:0.0:1790784613.197521:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359617536 00000100:00100000:0.0:1790784613.197581:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1790784613.197592:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+17:14333:x1877773359617536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790784613.197620:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784613.197637:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945909574c00/0x2c3a1e2a079d4ab2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d4aab expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784613.197669:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945909574c00/0x2c3a1e2a079d4ab2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d4aab expref: 18 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784613.197681:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945909574c00/0x2c3a1e2a079d4ab2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d4aab expref: 18 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784613.197690:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945909574c00, rc 0) 00000100:00100000:0.0:1790784613.197745:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+18:14333:x1877773359617536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784613.197753:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1790784613.197808:0:14333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945907df6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359617536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790784613.197825:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff94590955e000/0x2c3a1e2a079d4aab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4ab2 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784613.197846:0:14333:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff94590955e000/0x2c3a1e2a079d4aab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d4ab2 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784613.197917:0:14333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9459057c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359617664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790784613.197948:0:14333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784613.197975:0:14333:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910384900 going to sleep for 11 seconds 00000100:00100000:2.0:1790784613.198830:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359617664 00000100:00100000:2.0:1790784613.198841:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359617664 00000100:00100000:2.0:1790784613.198899:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790784613.198909:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+18:14333:x1877773359617664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790784613.199556:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ffae34-ce63-4427-b2f1-54f812a9cb4d+18:14333:x1877773359617664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 645us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784613.199578:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790784613.199755:0:14333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9459057c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359617664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790784613.199816:0:14333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590685f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359617792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790784613.199868:0:14333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784613.199903:0:14333:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910ac7480 going to sleep for 11 seconds 00000100:00100000:2.0:1790784613.199921:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359617792 00000100:00100000:2.0:1790784613.199927:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359617792 00000100:00100000:2.0:1790784613.199959:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790784613.199966:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+18:14333:x1877773359617792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790784613.200173:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+18:14333:x1877773359617792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784613.200181:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790784613.200221:0:14333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590685f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359617792:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790784613.206646:0:16509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1790784613.206908:0:14333:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1790784613.206953:0:14333:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790784613.206969:0:14333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff94590955e000/0x2c3a1e2a079d4aab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4ab2 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784613.206985:0:14333:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff94590955e000/0x2c3a1e2a079d4aab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4ab2 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790784613.206999:0:14333:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790784613.207002:0:14333:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94593c4ab000 from 10 10000000:01000000:2.0:1790784613.207005:0:14333:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790784613.207079:0:14333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.132@tcp lock: ffff94593fe74800/0x2c3a1e2a079d4ab9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784613.207103:0:14333:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.132@tcp lock: ffff94593fe74800/0x2c3a1e2a079d4ab9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784613.207118:0:14333:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.132@tcp lock: ffff94593fe74800/0x2c3a1e2a079d4ab9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784613.207150:0:14333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590685f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359617920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790784613.207238:0:14333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784613.208203:0:14333:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910ac7480 going to sleep for 11 seconds 00000100:00100000:1.0:1790784613.208804:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359617920 00000100:00100000:1.0:1790784613.208817:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359617920 00000100:00100000:1.0:1790784613.208885:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790784613.208896:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+18:14333:x1877773359617920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790784613.208922:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784613.208944:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94590955ea00/0x2c3a1e2a079d4ac0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2c3a1e2a079d4ab9 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784613.208980:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94590955ea00/0x2c3a1e2a079d4ac0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2c3a1e2a079d4ab9 expref: 19 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784613.208993:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94590955ea00/0x2c3a1e2a079d4ac0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2c3a1e2a079d4ab9 expref: 19 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784613.209003:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94590955ea00, rc 0) 00000100:00100000:1.0:1790784613.211999:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+19:14333:x1877773359617920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3090us (4747us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784613.212015:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790784613.212577:0:14333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590685f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359617920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790784613.212617:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.132@tcp lock: ffff94593fe74800/0x2c3a1e2a079d4ab9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4ac0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784613.212632:0:14333:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.132@tcp lock: ffff94593fe74800/0x2c3a1e2a079d4ab9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2c3a1e2a079d4ac0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784613.212746:0:14333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590685f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359618048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790784613.212809:0:14333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784613.212851:0:14333:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910ac7480 going to sleep for 11 seconds 00000100:00100000:1.0:1790784613.213969:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359618048 00000100:00100000:1.0:1790784613.213981:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359618048 00000100:00100000:1.0:1790784613.214053:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790784613.215040:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+19:14333:x1877773359618048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790784613.215840:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+19:14333:x1877773359618048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 818us (3027us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784613.215853:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790784613.217962:0:14333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590685f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359618048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790784613.218219:0:14333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590685f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359618176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790784613.218557:0:14333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784613.218683:0:14333:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910ac7480 going to sleep for 11 seconds 00000100:00100000:2.0:1790784613.218714:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359618176 00000100:00100000:2.0:1790784613.218722:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359618176 00000100:00100000:2.0:1790784613.218790:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1790784613.218800:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+19:14333:x1877773359618176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790784613.220438:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ffae34-ce63-4427-b2f1-54f812a9cb4d+19:14333:x1877773359618176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1631us (1874us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784613.220453:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790784613.221190:0:14333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590685f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:43ffae34-ce63-4427-b2f1-54f812a9cb4d:14333:1877773359618176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790784613.234245:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784613.234301:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344947584 00000100:00100000:0.0:1790784613.234314:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344947584 00000100:00100000:0.0:1790784613.235393:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 114 00000100:00100000:0.0:1790784613.235410:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9cd6e380-086e-4f8a-8222-c63218e0c889+11:13739:x1877773344947584:12345-192.168.206.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790784613.235433:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784613.235458:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945909574800/0x2c3a1e2a079d4ac7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x394e0d8838135443 expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784613.235496:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945909574800/0x2c3a1e2a079d4ac7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135443 expref: 12 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784613.235682:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945909574800/0x2c3a1e2a079d4ac7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135443 expref: 12 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784613.235695:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945909574800, rc 0) 00000100:00100000:0.0:1790784613.235782:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9cd6e380-086e-4f8a-8222-c63218e0c889+12:13739:x1877773344947584:12345-192.168.206.32@tcp:101:ll_cfg_requeue.0 Request processed in 375us (1548us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784613.235790:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 114 00000040:00080000:1.0:1790784613.239738:0:16511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1790784613.244141:0:14333:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1790784613.244191:0:14333:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790784613.244206:0:14333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.132@tcp lock: ffff94593fe74800/0x2c3a1e2a079d4ab9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4ac0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784613.244220:0:14333:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.132@tcp lock: ffff94593fe74800/0x2c3a1e2a079d4ab9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2c3a1e2a079d4ac0 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784613.245912:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784613.255215:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344947712 00000100:00100000:1.0:1790784613.255236:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344947712 00000100:00100000:1.0:1790784613.255411:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 115 00000100:00100000:1.0:1790784613.255425:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9cd6e380-086e-4f8a-8222-c63218e0c889+12:13739:x1877773344947712:12345-192.168.206.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790784613.255816:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9cd6e380-086e-4f8a-8222-c63218e0c889+12:13739:x1877773344947712:12345-192.168.206.32@tcp:501:ll_cfg_requeue.0 Request processed in 392us (9915us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784613.255826:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 115 00000100:00100000:1.0:1790784613.268439:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784613.268483:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344947840 00000100:00100000:1.0:1790784613.268507:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344947840 00000100:00100000:1.0:1790784613.268572:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 116 00000100:00100000:1.0:1790784613.268584:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9cd6e380-086e-4f8a-8222-c63218e0c889+12:13739:x1877773344947840:12345-192.168.206.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790784613.268875:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9cd6e380-086e-4f8a-8222-c63218e0c889+12:13739:x1877773344947840:12345-192.168.206.32@tcp:503:ll_cfg_requeue.0 Request processed in 293us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784613.268885:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 116 00000100:00100000:1.0:1790784613.282470:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784613.282914:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344947968 00000100:00100000:3.0:1790784613.282928:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344947968 00000100:00100000:3.0:1790784613.283003:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 117 00000100:00100000:3.0:1790784613.283015:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9cd6e380-086e-4f8a-8222-c63218e0c889+12:13739:x1877773344947968:12345-192.168.206.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790784613.283047:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784613.283070:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945802d2ea00/0x2c3a1e2a079d4ace lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x394e0d883813544a expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784613.283109:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945802d2ea00/0x2c3a1e2a079d4ace lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813544a expref: 13 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784613.283122:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945802d2ea00/0x2c3a1e2a079d4ace lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813544a expref: 13 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784613.283132:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945802d2ea00, rc 0) 00000100:00100000:3.0:1790784613.283199:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9cd6e380-086e-4f8a-8222-c63218e0c889+13:13739:x1877773344947968:12345-192.168.206.32@tcp:101:ll_cfg_requeue.0 Request processed in 187us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784613.283206:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 117 00000100:00100000:1.0:1790784613.291029:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784613.293136:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344948096 00000100:00100000:2.0:1790784613.293156:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344948096 00000100:00100000:2.0:1790784613.293250:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 118 00000100:00100000:2.0:1790784613.293262:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9cd6e380-086e-4f8a-8222-c63218e0c889+13:13739:x1877773344948096:12345-192.168.206.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790784613.293685:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9cd6e380-086e-4f8a-8222-c63218e0c889+13:13739:x1877773344948096:12345-192.168.206.32@tcp:501:ll_cfg_requeue.0 Request processed in 424us (2679us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784613.293694:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 118 00000100:00100000:3.0:1790784613.308190:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784613.308233:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344948224 00000100:00100000:3.0:1790784613.308244:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344948224 00000100:00100000:3.0:1790784613.308300:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 119 00000100:00100000:3.0:1790784613.308311:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9cd6e380-086e-4f8a-8222-c63218e0c889+13:13739:x1877773344948224:12345-192.168.206.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790784613.309177:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9cd6e380-086e-4f8a-8222-c63218e0c889+13:13739:x1877773344948224:12345-192.168.206.32@tcp:503:ll_cfg_requeue.0 Request processed in 860us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784613.309189:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 119 00000100:00100000:1.0:1790784613.309952:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945907df5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359618304:0@lo:400:kworker.0 00000100:00100000:1.0:1790784613.310010:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784613.310067:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945907df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1877773359618816:0@lo:400:kworker.0 00000100:00100000:1.0:1790784613.310092:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784613.310117:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790784613.310122:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945907df4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359618432:0@lo:400:kworker.0 00000100:00100000:1.0:1790784613.310142:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784613.310181:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945907df4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1877773359618560:0@lo:400:kworker.0 00000100:00100000:1.0:1790784613.310205:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784613.310222:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790784613.310226:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945907df7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359618688:0@lo:400:kworker.0 00000100:00100000:1.0:1790784613.310245:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784613.310279:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359618304 00000100:00100000:1.0:1790784613.310287:0:15022:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359618304 00000100:00100000:1.0:1790784613.310663:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359618432 00000100:00100000:1.0:1790784613.310668:0:15022:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359618432 00000100:00100000:3.0:1790784613.310996:0:15020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790784613.311008:0:15020:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359618304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784613.311086:0:15020:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359618304:12345-0@lo:400:kworker.0 Request processed in 81us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784613.311093:0:15020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790784613.311114:0:15020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790784613.311121:0:15020:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359618432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784613.311148:0:15020:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1877773359618432:12345-0@lo:400:kworker.0 Request processed in 28us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784613.311154:0:15020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790784613.311421:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359618816 00000100:00100000:1.0:1790784613.311427:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359618816 00000100:00100000:1.0:1790784613.311465:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359618560 00000100:00100000:1.0:1790784613.311469:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359618560 00000100:00100000:1.0:1790784613.311491:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359618688 00000100:00100000:1.0:1790784613.311494:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359618688 00000100:00100000:0.0:1790784613.311529:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790784613.311541:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1877773359618816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784613.311586:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1877773359618816:12345-0@lo:400:kworker.0 Request processed in 48us (1492us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784613.311593:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790784613.311608:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790784613.311615:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1877773359618560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790784613.311656:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1877773359618560:12345-0@lo:400:kworker.0 Request processed in 41us (1449us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784613.311662:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790784613.311758:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790784613.311768:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359618688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784613.311806:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359618688:12345-0@lo:400:kworker.0 Request processed in 40us (1559us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784613.311812:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790784613.311839:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359618944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790784613.311878:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784613.311953:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945907df4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359618432:0@lo:400:kworker.0 00000100:00100000:1.0:1790784613.311966:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945907df5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3281:1877773359618304:0@lo:400:kworker.0 00000100:00100000:1.0:1790784613.311977:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945907df6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1877773359618816:0@lo:400:kworker.0 00000100:00080000:1.0:1790784613.312060:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790784613.312066:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790784613.312095:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945907df7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359618688:0@lo:400:kworker.0 00000100:00100000:1.0:1790784613.312107:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945907df4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3279:1877773359618560:0@lo:400:kworker.0 00000100:00100000:0.0:1790784613.312543:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359618944 00000100:00100000:0.0:1790784613.312549:0:15024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359618944 00000100:00100000:0.0:1790784613.312593:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790784613.312602:0:15024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359618944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790784613.312636:0:15024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790784613.312689:0:15024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1877773359618944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784613.312697:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790784613.316148:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3282:1877773359618944:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790784613.499227:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790784614.079977:0:14368:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790784614.522514:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790784614.833953:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784614.834009:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784614.834114:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784614.834145:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784614.834218:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344948352 00000100:00100000:2.0:1790784614.834231:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344948352 00000100:00100000:2.0:1790784614.834300:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 120 00000100:00100000:2.0:1790784614.834311:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9cd6e380-086e-4f8a-8222-c63218e0c889+13:2352:x1877773344948352:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1790784614.834449:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9cd6e380-086e-4f8a-8222-c63218e0c889+13:2352:x1877773344948352:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 139us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784614.834479:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 120 00000100:00100000:0.0:1790784614.835564:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344948864 00000100:00100000:0.0:1790784614.835576:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344948864 00000100:00100000:0.0:1790784614.835668:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 23 00000100:00100000:0.0:1790784614.835679:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26f7a80f-38df-4ba4-8176-3236c76f443f+6:2352:x1877773344948864:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:0.0:1790784614.835753:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26f7a80f-38df-4ba4-8176-3236c76f443f+6:2352:x1877773344948864:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 77us (1639us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784614.835760:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 23 00000100:00080000:2.0:1790784614.835973:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790784614.840164:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784614.840194:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784614.840963:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344948480 00000100:00100000:2.0:1790784614.840977:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344948480 00000100:00100000:2.0:1790784614.841087:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 24 00000100:00100000:2.0:1790784614.841099:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4259360-45b3-4521-b0f8-25fb9487baea+6:2352:x1877773344948480:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1790784614.841205:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4259360-45b3-4521-b0f8-25fb9487baea+6:2352:x1877773344948480:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 109us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784614.841213:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 24 00000100:00080000:2.0:1790784614.841244:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790784614.848023:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344948608 00000100:00100000:3.0:1790784614.848165:0:15022:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344948608 00000100:00100000:3.0:1790784614.848267:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344949120 00000100:00100000:3.0:1790784614.848271:0:15022:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344949120 00000100:00100000:3.0:1790784614.848300:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 14 00000100:00100000:3.0:1790784614.848312:0:15022:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4259360-45b3-4521-b0f8-25fb9487baea+5:2352:x1877773344948608:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1790784614.848440:0:15022:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4259360-45b3-4521-b0f8-25fb9487baea+5:2352:x1877773344948608:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 131us (14431us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784614.848471:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 14 00000100:00100000:3.0:1790784614.848491:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 15 00000100:00100000:3.0:1790784614.848499:0:15022:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26f7a80f-38df-4ba4-8176-3236c76f443f+5:2352:x1877773344949120:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1790784614.848528:0:15022:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26f7a80f-38df-4ba4-8176-3236c76f443f+5:2352:x1877773344949120:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 30us (14382us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784614.848534:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 15 00000100:00080000:2.0:1790784614.848829:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790784614.848835:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790784614.849823:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784614.849894:0:15020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344948736 00000100:00100000:2.0:1790784614.849903:0:15020:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344948736 00000100:00100000:2.0:1790784614.849955:0:15020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344948992 00000100:00100000:2.0:1790784614.849958:0:15020:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344948992 00000100:00100000:2.0:1790784614.849974:0:15020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 16 00000100:00100000:2.0:1790784614.849983:0:15020:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907df4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4259360-45b3-4521-b0f8-25fb9487baea+5:2352:x1877773344948736:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1790784614.850060:0:15020:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907df4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4259360-45b3-4521-b0f8-25fb9487baea+5:2352:x1877773344948736:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 78us (9865us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784614.850068:0:15020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 16 00000100:00100000:2.0:1790784614.850084:0:15020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 17 00000100:00100000:2.0:1790784614.850089:0:15020:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26f7a80f-38df-4ba4-8176-3236c76f443f+5:2352:x1877773344948992:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1790784614.850111:0:15020:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26f7a80f-38df-4ba4-8176-3236c76f443f+5:2352:x1877773344948992:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 23us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784614.850133:0:15020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 17 00000100:00080000:0.0:1790784614.850596:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790784614.850603:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790784615.514194:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784615.514449:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344949248 00000100:00100000:1.0:1790784615.514464:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344949248 00000100:00100000:1.0:1790784615.514545:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 15 00000100:00100000:1.0:1790784615.514557:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4259360-45b3-4521-b0f8-25fb9487baea+6:14395:x1877773344949248:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790784615.514581:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784615.514609:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4ad5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135451 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.514686:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4adc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.514704:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4adc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.514721:0:14337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4adc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.514760:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4ae3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.514769:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4ae3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.514776:0:14337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4ae3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.515168:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955ee00/0x2c3a1e2a079d4aea lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.515177:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955ee00/0x2c3a1e2a079d4aea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.515184:0:14337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955ee00/0x2c3a1e2a079d4aea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790784615.515212:0:14337:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790784615.515216:0:14337:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790784615.515255:0:14337:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94590955ee00/0x2c3a1e2a079d4aea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.515266:0:14337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4adc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.515273:0:14337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4adc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.515279:0:14337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4adc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.515294:0:14337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955f000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784615.515298:0:14337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4adc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.515306:0:14337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4adc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.515320:0:14337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2e00) 00010000:00010000:1.0:1790784615.515323:0:14337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784615.515328:0:14337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4adc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.515334:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4adc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.515348:0:14337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4ae3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.515353:0:14337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4ae3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.515358:0:14337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4ae3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.515364:0:14337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955e400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784615.515367:0:14337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4ae3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.515428:0:14337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4ae3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.515446:0:14337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff94590345d000) 00010000:00010000:1.0:1790784615.515449:0:14337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784615.515451:0:14337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4ae3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.515458:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4ae3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.515500:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4ad5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135451 expref: 8 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.515516:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955ee00/0x2c3a1e2a079d4aea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135451 expref: 7 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.515524:0:14337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94590345d700) 00010000:00010000:1.0:1790784615.515527:0:14337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790784615.515529:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94590955ee00, rc 0) 00000100:00100000:1.0:1790784615.515614:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4259360-45b3-4521-b0f8-25fb9487baea+7:14395:x1877773344949248:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 1060us (1449us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784615.515624:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 15 00000100:00100000:2.0:1790784615.524488:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784615.525148:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344949504 00000100:00100000:1.0:1790784615.525163:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344949504 00000100:00100000:1.0:1790784615.525250:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 16 00000100:00100000:1.0:1790784615.525263:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590685f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4259360-45b3-4521-b0f8-25fb9487baea+7:14395:x1877773344949504:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790784615.525290:0:14336:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784615.525326:0:14336:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4af1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135458 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.525477:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4af8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.525492:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4af8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.525505:0:14336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4af8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.525651:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4aff lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.525671:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4aff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.525681:0:14336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4aff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.527186:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f200/0x2c3a1e2a079d4b06 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.527206:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f200/0x2c3a1e2a079d4b06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.527216:0:14336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f200/0x2c3a1e2a079d4b06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790784615.527227:0:14336:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1790784615.527551:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4af8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.527570:0:14336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4af8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.527577:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4af8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.527583:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955e400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784615.527588:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4af8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.527595:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4af8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.527608:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff94590345d700) 00010000:00010000:1.0:1790784615.527611:0:14336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784615.527616:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4af8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.527622:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4af8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.527637:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4aff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.527643:0:14336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4aff lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.527648:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4aff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.527653:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955f000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784615.527663:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4aff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.527670:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4aff lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.527678:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff94590345d000) 00010000:00010000:1.0:1790784615.527680:0:14336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784615.527683:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4aff lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.527689:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4aff lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.528641:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4af1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135458 expref: 10 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.528662:0:14336:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f200/0x2c3a1e2a079d4b06 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135458 expref: 9 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.528669:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94590345d300) 00010000:00010000:1.0:1790784615.528672:0:14336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784615.528674:0:14336:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94590955f200, rc 0) 00000100:00100000:1.0:1790784615.528954:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590685f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4259360-45b3-4521-b0f8-25fb9487baea+9:14395:x1877773344949504:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 3693us (4473us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1790784615.528963:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 16 00000100:00100000:3.0:1790784615.545131:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784615.545296:0:16214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344949632 00000100:00100000:0.0:1790784615.545307:0:16214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344949632 00000100:00100000:0.0:1790784615.545368:0:16214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 17 00000100:00100000:0.0:1790784615.545409:0:16214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4259360-45b3-4521-b0f8-25fb9487baea+9:14395:x1877773344949632:12345-192.168.206.32@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1790784615.545518:0:16214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4259360-45b3-4521-b0f8-25fb9487baea+9:14395:x1877773344949632:12345-192.168.206.32@tcp:59:lhsmtool_posix.0 Request processed in 111us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784615.545525:0:16214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 17 00010000:00010000:2.0:1790784615.546495:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784615.636002:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784615.636607:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344949760 00000100:00100000:1.0:1790784615.636622:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344949760 00000100:00100000:1.0:1790784615.636705:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 18 00000100:00100000:1.0:1790784615.636717:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4259360-45b3-4521-b0f8-25fb9487baea+9:14401:x1877773344949760:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:1.0:1790784615.636762:0:14336:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784615.636788:0:14336:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4b14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813545f expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.636875:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4b1b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.636894:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4b1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.636919:0:14336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4b1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.636938:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4b22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.636947:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4b22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.636957:0:14336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4b22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.638218:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4b1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.638237:0:14336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4b1b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.638358:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4b1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.638365:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955f000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784615.638398:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4b1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.638408:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4b1b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.638426:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2e00) 00010000:00010000:1.0:1790784615.638430:0:14336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784615.638436:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4b1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.638443:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4b1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.638461:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4b22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.638468:0:14336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4b22 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.638473:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4b22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.638478:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955e400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784615.638481:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4b22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.638487:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4b22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.638494:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff94590345d000) 00010000:00010000:1.0:1790784615.638497:0:14336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784615.638506:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4b22 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.638512:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4b22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.638564:0:14336:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4b14 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813545f expref: 10 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.638576:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2e00) 00010000:00010000:1.0:1790784615.638579:0:14336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784615.638583:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4b14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813545f expref: 10 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.638592:0:14336:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94590955e800, rc 0) 00000100:00100000:1.0:1790784615.638687:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4259360-45b3-4521-b0f8-25fb9487baea+9:14401:x1877773344949760:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 1972us (2700us total) trans 0 rc 301/301 00000100:00100000:1.0:1790784615.638697:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 18 00000100:00100000:2.0:1790784615.644962:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784615.645115:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344949888 00000100:00100000:3.0:1790784615.645125:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344949888 00000100:00100000:3.0:1790784615.645347:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 0 00000100:00100000:3.0:1790784615.645367:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590685ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f4259360-45b3-4521-b0f8-25fb9487baea+9:14401:x1877773344949888:12345-192.168.206.32@tcp:700:lfs.0 00000100:00100000:3.0:1790784615.645688:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590685ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f4259360-45b3-4521-b0f8-25fb9487baea+9:14401:x1877773344949888:12345-192.168.206.32@tcp:700:lfs.0 Request processed in 333us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784615.645696:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 0 00000100:00100000:3.0:1790784615.649866:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784615.650298:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344950144 00000100:00100000:1.0:1790784615.650308:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344950144 00000100:00100000:1.0:1790784615.650471:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 19 00000100:00100000:1.0:1790784615.650483:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4259360-45b3-4521-b0f8-25fb9487baea+9:14401:x1877773344950144:12345-192.168.206.32@tcp:36:lfs.0 00010000:00010000:1.0:1790784615.650947:0:14337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784615.650973:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d4a57 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381353da expref: 9 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.650993:0:14337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2e00) 00010000:00010000:1.0:1790784615.650997:0:14337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790784615.651300:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4b29 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.651319:0:14337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945909574e00/0x2c3a1e2a079d4a8f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813543c expref: 5 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.651329:0:14337:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4b29 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.651524:0:14337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945909574e00/0x2c3a1e2a079d4a8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813543c expref: 5 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.651552:0:14337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945909574e00/0x2c3a1e2a079d4a8f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813543c expref: 5 pid: 14336 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784615.651566:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d223b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14337:1877773359619072:192.168.206.32@tcp:104: 00000100:00100000:1.0:1790784615.651649:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910ff8900 going to sleep for 11 seconds 00000100:00100000:1.0:1790784615.653590:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d223b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14337:1877773359619072:192.168.206.32@tcp:104: 00010000:00010000:1.0:1790784615.653618:0:14337:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4b29 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784615.654559:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784615.655034:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344950272 00000100:00100000:0.0:1790784615.655050:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344950272 00010000:00010000:0.0:1790784615.655081:0:14321:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945909574e00/0x2c3a1e2a079d4a8f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813543c expref: 6 pid: 14336 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784615.655124:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 9 00000100:00100000:0.0:1790784615.655138:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26f7a80f-38df-4ba4-8176-3236c76f443f+6:2351:x1877773344950272:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790784615.655152:0:14321:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784615.655158:0:14321:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945909574e00/0x2c3a1e2a079d4a8f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813543c expref: 6 pid: 14336 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784615.655170:0:14321:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945909574e00/0x2c3a1e2a079d4a8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813543c expref: 6 pid: 14336 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784615.655556:0:14321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945909574e00/0x2c3a1e2a079d4a8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d883813543c expref: 6 pid: 14336 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784615.655591:0:14321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2e00) 00010000:00010000:0.0:1790784615.655596:0:14321:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4b29 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784615.655605:0:14321:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4b29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784615.655613:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4b29 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784615.655645:0:14321:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790784615.655693:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:26f7a80f-38df-4ba4-8176-3236c76f443f+5:2351:x1877773344950272:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 561us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784615.655701:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 9 00010000:00010000:1.0:1790784615.655751:0:14337:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4b29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.655759:0:14337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4b29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.655780:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4b30 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.655802:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4b30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.655811:0:14337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4b30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790784615.657898:0:14337:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790784615.657916:0:14337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4b29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.657927:0:14337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4b29 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.657935:0:14337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4b29 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.657941:0:14337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955e800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784615.657946:0:14337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4b29 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.657954:0:14337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4b29 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.657967:0:14337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2e00) 00010000:00010000:1.0:1790784615.657970:0:14337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790784615.657975:0:14337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4b29 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.657980:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4b29 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790784615.658027:0:14337:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008abd619b reply state 000000003dad157e transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4b30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784615.658035:0:14337:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790784615.658121:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4259360-45b3-4521-b0f8-25fb9487baea+10:14401:x1877773344950144:12345-192.168.206.32@tcp:36:lfs.0 Request processed in 7639us (8261us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1790784615.658129:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 19 00010000:00010000:3.0:1790784615.660934:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4b30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784615.660950:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4b30 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784615.660957:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4b30 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784615.660962:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955e400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784615.660977:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4b30 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784615.660985:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4b30 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784615.661000:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff94590345d000) 00010000:00010000:3.0:1790784615.661003:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784615.661019:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4b30 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784615.661024:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e400/0x2c3a1e2a079d4b30 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784615.715511:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784615.715959:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344950400 00000100:00100000:2.0:1790784615.715968:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344950400 00000100:00100000:2.0:1790784615.716036:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 20 00000100:00100000:2.0:1790784615.716046:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4259360-45b3-4521-b0f8-25fb9487baea+9:14409:x1877773344950400:12345-192.168.206.32@tcp:101:lctl.0 00010000:00010000:2.0:1790784615.716069:0:14335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784615.716090:0:14335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4b37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135466 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.716162:0:14335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d4b3e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.716175:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d4b3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.716186:0:14335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d4b3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784615.716219:0:14335:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790784615.716223:0:14335:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790784615.716257:0:14335:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d4b3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.716278:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4b37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135466 expref: 11 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.716313:0:14335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75a00/0x2c3a1e2a079d4b3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135466 expref: 10 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.716321:0:14335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2a00) 00010000:00010000:2.0:1790784615.716324:0:14335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790784615.716327:0:14335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe75a00, rc 0) 00000100:00100000:2.0:1790784615.716429:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4259360-45b3-4521-b0f8-25fb9487baea+10:14409:x1877773344950400:12345-192.168.206.32@tcp:101:lctl.0 Request processed in 384us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784615.716437:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 20 00000100:00100000:0.0:1790784615.757295:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784615.757919:0:16214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344950528 00000100:00100000:2.0:1790784615.757930:0:16214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344950528 00000100:00100000:2.0:1790784615.757994:0:16214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 21 00000100:00100000:2.0:1790784615.758016:0:16214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26f7a80f-38df-4ba4-8176-3236c76f443f+5:14410:x1877773344950528:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:2.0:1790784615.758035:0:16214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784615.758055:0:16214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4b45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813546d expref: -99 pid: 16214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.758904:0:16214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d4b4c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.758921:0:16214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d4b4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.758933:0:16214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d4b4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784615.758968:0:16214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790784615.758985:0:16214:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790784615.759017:0:16214:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d4b4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.759046:0:16214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4b45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813546d expref: 7 pid: 16214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.759066:0:16214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75400/0x2c3a1e2a079d4b4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813546d expref: 6 pid: 16214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.759075:0:16214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2a00) 00010000:00010000:2.0:1790784615.759077:0:16214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790784615.759081:0:16214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe75400, rc 0) 00000100:00100000:2.0:1790784615.759986:0:16214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26f7a80f-38df-4ba4-8176-3236c76f443f+6:14410:x1877773344950528:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 1978us (2695us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784615.759995:0:16214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 21 00000100:00100000:3.0:1790784615.770476:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784615.770747:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344950656 00000100:00100000:2.0:1790784615.770757:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344950656 00000100:00100000:2.0:1790784615.770817:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 22 00000100:00100000:2.0:1790784615.770827:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26f7a80f-38df-4ba4-8176-3236c76f443f+6:14410:x1877773344950656:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:2.0:1790784615.770846:0:14335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784615.770866:0:14335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4b53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135474 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.770937:0:14335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4b5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.771033:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4b5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.771137:0:14335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4b5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.771151:0:14335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4b61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.771159:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4b61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.771164:0:14335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4b61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.771592:0:14335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4b68 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.771602:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4b68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.771609:0:14335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4b68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784615.771644:0:14335:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790784615.771646:0:14335:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790784615.771663:0:14335:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4b68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.771674:0:14335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4b5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.771680:0:14335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4b5a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.771699:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4b5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.771705:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784615.771709:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4b5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.771716:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4b5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.771728:0:14335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2a00) 00010000:00010000:2.0:1790784615.771730:0:14335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784615.771735:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4b5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.771740:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4b5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.771753:0:14335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4b61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.771760:0:14335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4b61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.771766:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4b61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.771771:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75c00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784615.771774:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4b61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.771789:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4b61 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.771805:0:14335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff945903af2200) 00010000:00010000:2.0:1790784615.771807:0:14335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784615.771810:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4b61 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.771816:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4b61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.771850:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4b53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135474 expref: 8 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.771864:0:14335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4b68 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135474 expref: 7 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.771870:0:14335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff945903af2c00) 00010000:00010000:2.0:1790784615.771872:0:14335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790784615.771874:0:14335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74e00, rc 0) 00000100:00100000:2.0:1790784615.772356:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:26f7a80f-38df-4ba4-8176-3236c76f443f+7:14410:x1877773344950656:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 1528us (1886us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784615.772364:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 22 00000100:00100000:3.0:1790784615.777190:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784615.777409:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344950912 00000100:00100000:1.0:1790784615.777418:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344950912 00000100:00100000:1.0:1790784615.777477:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 23 00000100:00100000:1.0:1790784615.777486:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26f7a80f-38df-4ba4-8176-3236c76f443f+7:14410:x1877773344950912:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:1.0:1790784615.777503:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784615.777521:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4b6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813547b expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790784615.777603:0:14337:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790784615.777709:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4b6f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813547b expref: 9 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.777722:0:14337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2a00) 00010000:00010000:1.0:1790784615.777725:0:14337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790784615.777730:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4b6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813547b expref: 9 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.777745:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94590955e800, rc 0) 00000100:00100000:1.0:1790784615.777795:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26f7a80f-38df-4ba4-8176-3236c76f443f+8:14410:x1877773344950912:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 311us (614us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1790784615.777816:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 23 00000100:00100000:0.0:1790784615.787678:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784615.787823:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344951168 00000100:00100000:1.0:1790784615.787833:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344951168 00000100:00100000:1.0:1790784615.787895:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 24 00000100:00100000:1.0:1790784615.787905:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26f7a80f-38df-4ba4-8176-3236c76f443f+8:14410:x1877773344951168:12345-192.168.206.32@tcp:36:lfs.0 00010000:00010000:1.0:1790784615.787968:0:14336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784615.787993:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4b68 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135474 expref: 8 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.788022:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff945903af2c00) 00010000:00010000:1.0:1790784615.788034:0:14336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790784615.788067:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4b7d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.788080:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4b7d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.788090:0:14336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4b7d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790784615.788296:0:14336:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008be97689 reply state 000000002b0c28d0 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4b7d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784615.788305:0:14336:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1790784615.788312:0:14336:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1790784615.788441:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26f7a80f-38df-4ba4-8176-3236c76f443f+9:14410:x1877773344951168:12345-192.168.206.32@tcp:36:lfs.0 Request processed in 537us (770us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1790784615.788448:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 24 00010000:00010000:0.0:1790784615.791428:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4b7d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784615.791443:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4b7d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784615.791451:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4b7d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784615.791457:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955e800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784615.791462:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4b7d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784615.791497:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4b7d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784615.791513:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94590345d600) 00010000:00010000:0.0:1790784615.791516:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790784615.791521:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4b7d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784615.791528:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955e800/0x2c3a1e2a079d4b7d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784615.796464:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784615.796795:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344951424 00000100:00100000:2.0:1790784615.796805:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344951424 00000100:00100000:2.0:1790784615.796850:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 2 00000100:00100000:2.0:1790784615.796860:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26f7a80f-38df-4ba4-8176-3236c76f443f+8:14410:x1877773344951424:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:2.0:1790784615.797124:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26f7a80f-38df-4ba4-8176-3236c76f443f+9:14410:x1877773344951424:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 265us (668us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1790784615.797132:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 2 00000100:00100000:3.0:1790784615.802474:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784615.802726:0:16214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344951680 00000100:00100000:2.0:1790784615.802736:0:16214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344951680 00000100:00100000:2.0:1790784615.802783:0:16214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 25 00000100:00100000:2.0:1790784615.802793:0:16214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26f7a80f-38df-4ba4-8176-3236c76f443f+9:14410:x1877773344951680:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:2.0:1790784615.802816:0:16214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784615.802835:0:16214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4b84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135482 expref: -99 pid: 16214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.802900:0:16214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4b8b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.802914:0:16214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4b8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.802925:0:16214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4b8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.802939:0:16214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4b92 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.802946:0:16214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4b92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.802967:0:16214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4b92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784615.803082:0:16214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790784615.803178:0:16214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4b8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.803186:0:16214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4b8b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.803193:0:16214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4b8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.803198:0:16214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75c00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784615.803201:0:16214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4b8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.803208:0:16214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4b8b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.803220:0:16214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2a00) 00010000:00010000:2.0:1790784615.803222:0:16214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784615.803227:0:16214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4b8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.803232:0:16214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4b8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.803245:0:16214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4b92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.803250:0:16214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4b92 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.803255:0:16214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4b92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.803268:0:16214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784615.803272:0:16214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4b92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.803278:0:16214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4b92 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.803285:0:16214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff945903af2200) 00010000:00010000:2.0:1790784615.803288:0:16214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784615.803290:0:16214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4b92 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.803295:0:16214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4b92 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.803331:0:16214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4b84 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135482 expref: 11 pid: 16214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.803341:0:16214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2a00) 00010000:00010000:2.0:1790784615.803343:0:16214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790784615.803347:0:16214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4b84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135482 expref: 11 pid: 16214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.803356:0:16214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe75000, rc 0) 00000100:00100000:2.0:1790784615.803449:0:16214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26f7a80f-38df-4ba4-8176-3236c76f443f+10:14410:x1877773344951680:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 658us (984us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1790784615.803456:0:16214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 25 00000100:00100000:0.0:1790784615.810745:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784615.810836:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344951808 00000100:00100000:1.0:1790784615.810845:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344951808 00000100:00100000:1.0:1790784615.810910:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 26 00000100:00100000:1.0:1790784615.810919:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26f7a80f-38df-4ba4-8176-3236c76f443f+10:14410:x1877773344951808:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:1.0:1790784615.810943:0:14336:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784615.811164:0:14336:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4ba0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135489 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.811578:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f600/0x2c3a1e2a079d4ba7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.811592:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f600/0x2c3a1e2a079d4ba7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.811604:0:14336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f600/0x2c3a1e2a079d4ba7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790784615.811628:0:14336:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790784615.811631:0:14336:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790784615.811646:0:14336:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f600/0x2c3a1e2a079d4ba7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.811671:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4ba0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135489 expref: 12 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.811687:0:14336:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f600/0x2c3a1e2a079d4ba7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135489 expref: 11 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.811694:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94590345d900) 00010000:00010000:1.0:1790784615.811697:0:14336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790784615.811707:0:14336:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94590955f600, rc 0) 00000100:00100000:1.0:1790784615.811769:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26f7a80f-38df-4ba4-8176-3236c76f443f+11:14410:x1877773344951808:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 851us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784615.811775:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 26 00000100:00100000:0.0:1790784615.818774:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784615.818867:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344951936 00000100:00100000:2.0:1790784615.818890:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344951936 00000100:00100000:2.0:1790784615.818988:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 3 00000100:00100000:2.0:1790784615.818998:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26f7a80f-38df-4ba4-8176-3236c76f443f+11:14410:x1877773344951936:12345-192.168.206.32@tcp:37:lfs.0 00000100:00100000:3.0:1790784615.824138:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:26f7a80f-38df-4ba4-8176-3236c76f443f+11:14410:x1877773344951936:12345-192.168.206.32@tcp:37:lfs.0 Request processed in 5132us (5363us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784615.824150:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 3 00000100:00100000:0.0:1790784615.829463:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784615.829616:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344952192 00000100:00100000:1.0:1790784615.829626:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344952192 00000100:00100000:1.0:1790784615.829681:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 4 00000100:00100000:1.0:1790784615.829692:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907d30450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26f7a80f-38df-4ba4-8176-3236c76f443f+11:14410:x1877773344952192:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:1.0:1790784615.830127:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907d30450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:26f7a80f-38df-4ba4-8176-3236c76f443f+12:14410:x1877773344952192:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 435us (670us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1790784615.830135:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 4 00000100:00100000:0.0:1790784615.910903:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784615.911123:0:16214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344952320 00000100:00100000:2.0:1790784615.911132:0:16214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344952320 00000100:00100000:2.0:1790784615.911189:0:16214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 27 00000100:00100000:2.0:1790784615.911199:0:16214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4259360-45b3-4521-b0f8-25fb9487baea+10:14416:x1877773344952320:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:2.0:1790784615.911217:0:16214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784615.911237:0:16214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4bae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135490 expref: -99 pid: 16214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.911294:0:16214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4bb5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.911307:0:16214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4bb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.911319:0:16214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4bb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.911333:0:16214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4bbc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.911341:0:16214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4bbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.911348:0:16214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4bbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.911476:0:16214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d4bc3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.911638:0:16214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d4bc3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.911648:0:16214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d4bc3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784615.911675:0:16214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790784615.911678:0:16214:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790784615.911709:0:16214:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d4bc3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.911720:0:16214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4bb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.911726:0:16214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4bb5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.911732:0:16214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4bb5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.911738:0:16214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75c00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784615.911742:0:16214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4bb5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.911749:0:16214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4bb5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.911759:0:16214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2a00) 00010000:00010000:2.0:1790784615.911762:0:16214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784615.911766:0:16214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4bb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.912133:0:16214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4bb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.912150:0:16214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4bbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.912155:0:16214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4bbc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.912161:0:16214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4bbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.912165:0:16214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74200 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784615.912168:0:16214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4bbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.912174:0:16214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4bbc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.912183:0:16214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff945903af2200) 00010000:00010000:2.0:1790784615.912185:0:16214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784615.912188:0:16214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4bbc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.912192:0:16214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4bbc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.912227:0:16214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4bae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135490 expref: 12 pid: 16214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.912254:0:16214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74000/0x2c3a1e2a079d4bc3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135490 expref: 11 pid: 16214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784615.912260:0:16214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94590345d900) 00010000:00010000:2.0:1790784615.912262:0:16214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790784615.912265:0:16214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74000, rc 0) 00000100:00100000:2.0:1790784615.912319:0:16214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4259360-45b3-4521-b0f8-25fb9487baea+11:14416:x1877773344952320:12345-192.168.206.32@tcp:101:bash.0 Request processed in 1121us (1424us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784615.912327:0:16214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 27 00000100:00100000:2.0:1790784615.929694:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784615.929784:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344952576 00000100:00100000:3.0:1790784615.929795:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344952576 00000100:00100000:3.0:1790784615.929856:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 28 00000100:00100000:3.0:1790784615.929866:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590685e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4259360-45b3-4521-b0f8-25fb9487baea+11:14416:x1877773344952576:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:3.0:1790784615.929885:0:14335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784615.929904:0:14335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f600/0x2c3a1e2a079d4bca lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135497 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784615.930019:0:14335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4bd1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784615.930056:0:14335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f600/0x2c3a1e2a079d4ba7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135489 expref: 11 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784615.930066:0:14335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4bd1 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784615.930097:0:14335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f600/0x2c3a1e2a079d4ba7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135489 expref: 11 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784615.930110:0:14335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f600/0x2c3a1e2a079d4ba7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135489 expref: 11 pid: 14336 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784615.930122:0:14335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14335:1877773359619200:192.168.206.32@tcp:104: 00000100:00100000:3.0:1790784615.930216:0:14335:0:(client.c:2716:ptlrpc_set_wait()) set ffff945906616a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790784615.944627:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784615.944771:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344952704 00000100:00100000:1.0:1790784615.944779:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344952704 00010000:00010000:1.0:1790784615.944816:0:14322:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f600/0x2c3a1e2a079d4ba7 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135489 expref: 12 pid: 14336 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784615.944857:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 10 00000100:00100000:1.0:1790784615.944866:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26f7a80f-38df-4ba4-8176-3236c76f443f+12:2351:x1877773344952704:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790784615.944881:0:14322:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784615.944887:0:14322:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f600/0x2c3a1e2a079d4ba7 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135489 expref: 12 pid: 14336 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.944901:0:14322:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f600/0x2c3a1e2a079d4ba7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135489 expref: 12 pid: 14336 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.944920:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94590345d900) 00010000:00010000:1.0:1790784615.944926:0:14322:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4bd1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.944950:0:14322:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4bd1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.944958:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4bd1 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.944978:0:14322:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790784615.945048:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:26f7a80f-38df-4ba4-8176-3236c76f443f+12:2351:x1877773344952704:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 174us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784615.945056:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 10 00010000:00010000:3.0:1790784615.945193:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f600/0x2c3a1e2a079d4ba7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135489 expref: 11 pid: 14336 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784615.945211:0:14335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14335:1877773359619200:192.168.206.32@tcp:104: 00010000:00010000:3.0:1790784615.945233:0:14335:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4bd1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784615.945242:0:14335:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4bd1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784615.945249:0:14335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4bd1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784615.945343:0:14335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e000/0x2c3a1e2a079d4bd8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784615.945358:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e000/0x2c3a1e2a079d4bd8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784615.945366:0:14335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e000/0x2c3a1e2a079d4bd8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784615.946808:0:14335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e200/0x2c3a1e2a079d4bdf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784615.946822:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e200/0x2c3a1e2a079d4bdf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784615.946831:0:14335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e200/0x2c3a1e2a079d4bdf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790784615.946841:0:14335:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1790784615.946865:0:14335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4bd1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784615.946872:0:14335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4bd1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784615.946879:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4bd1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784615.946885:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2e600 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784615.946889:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4bd1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784615.946896:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4bd1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784615.946916:0:14335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94590345d900) 00010000:00010000:3.0:1790784615.946919:0:14335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784615.946923:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4bd1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784615.946929:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4bd1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790784615.946942:0:14335:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf9dc8d5 reply state 00000000b0d51e8d transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e000/0x2c3a1e2a079d4bd8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784615.946949:0:14335:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790784615.946980:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f600/0x2c3a1e2a079d4bca lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135497 expref: 14 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784615.946995:0:14335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e200/0x2c3a1e2a079d4bdf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135497 expref: 13 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784615.947002:0:14335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94592785a800) 00010000:00010000:3.0:1790784615.947016:0:14335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1790784615.947018:0:14335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945802d2e200, rc 0) 00000100:00100000:3.0:1790784615.947077:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590685e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4259360-45b3-4521-b0f8-25fb9487baea+14:14416:x1877773344952576:12345-192.168.206.32@tcp:101:bash.0 Request processed in 17213us (17392us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1790784615.947084:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 28 00010000:00010000:3.0:1790784615.952981:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e000/0x2c3a1e2a079d4bd8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784615.953000:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e000/0x2c3a1e2a079d4bd8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784615.953031:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e000/0x2c3a1e2a079d4bd8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784615.953046:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2e000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784615.953051:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e000/0x2c3a1e2a079d4bd8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784615.953059:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e000/0x2c3a1e2a079d4bd8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784615.953074:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff94592785ab00) 00010000:00010000:3.0:1790784615.953077:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784615.953082:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e000/0x2c3a1e2a079d4bd8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784615.953088:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e000/0x2c3a1e2a079d4bd8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784615.969283:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784615.969455:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344952832 00000100:00100000:1.0:1790784615.969465:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344952832 00000100:00100000:1.0:1790784615.969535:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 29 00000100:00100000:1.0:1790784615.969545:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4259360-45b3-4521-b0f8-25fb9487baea+13:14416:x1877773344952832:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:1.0:1790784615.969580:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784615.969601:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4bed lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813549e expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.969662:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955ec00/0x2c3a1e2a079d4bf4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.969675:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955ec00/0x2c3a1e2a079d4bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.969686:0:14337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955ec00/0x2c3a1e2a079d4bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790784615.969721:0:14337:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1790784615.969725:0:14337:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790784615.969761:0:14337:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94590955ec00/0x2c3a1e2a079d4bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.969772:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955ec00/0x2c3a1e2a079d4bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.969807:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4bed lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813549e expref: 15 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.969824:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955ec00/0x2c3a1e2a079d4bf4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813549e expref: 14 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784615.969832:0:14337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94592785a800) 00010000:00010000:1.0:1790784615.969835:0:14337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790784615.969838:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94590955ec00, rc 0) 00000100:00100000:1.0:1790784615.969897:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4259360-45b3-4521-b0f8-25fb9487baea+14:14416:x1877773344952832:12345-192.168.206.32@tcp:101:bash.0 Request processed in 353us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784615.969903:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 29 00000100:00100000:0.0:1790784615.977549:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784615.977877:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344953088 00000100:00100000:3.0:1790784615.977887:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344953088 00000100:00100000:3.0:1790784615.977941:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 5 00000100:00100000:3.0:1790784615.977951:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4259360-45b3-4521-b0f8-25fb9487baea+14:14416:x1877773344953088:12345-192.168.206.32@tcp:35:bash.0 00000100:00100000:3.0:1790784615.981214:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4259360-45b3-4521-b0f8-25fb9487baea+15:14416:x1877773344953088:12345-192.168.206.32@tcp:35:bash.0 Request processed in 3253us (3663us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1790784615.981227:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 5 00000100:00100000:3.0:1790784616.113802:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784616.113891:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344953344 00000100:00100000:1.0:1790784616.113900:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344953344 00000100:00080000:0.0:1790784616.113976:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790784616.113985:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 30 00000100:00100000:1.0:1790784616.113999:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4259360-45b3-4521-b0f8-25fb9487baea+15:14426:x1877773344953344:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:1.0:1790784616.114031:0:14336:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784616.114050:0:14336:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4bfb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381354a5 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790784616.114139:0:14336:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790784616.114247:0:14336:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4bfb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354a5 expref: 17 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784616.114278:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2a00) 00010000:00010000:1.0:1790784616.114281:0:14336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790784616.114287:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4bfb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354a5 expref: 17 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784616.114300:0:14336:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94590955f000, rc 0) 00000100:00100000:1.0:1790784616.114359:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4259360-45b3-4521-b0f8-25fb9487baea+16:14426:x1877773344953344:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 366us (564us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1790784616.114366:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 30 00000100:00100000:0.0:1790784616.116578:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784616.117827:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344953600 00000100:00100000:1.0:1790784616.117840:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344953600 00000100:00100000:1.0:1790784616.117915:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 6 00000100:00100000:1.0:1790784616.117936:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4259360-45b3-4521-b0f8-25fb9487baea+16:14426:x1877773344953600:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:1.0:1790784616.118194:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4259360-45b3-4521-b0f8-25fb9487baea+17:14426:x1877773344953600:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 260us (1621us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1790784616.118201:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 6 00000040:00080000:1.0:1790784616.123362:0:14368:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790784616.159363:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784616.162677:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344953856 00000100:00100000:2.0:1790784616.162690:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344953856 00000100:00100000:2.0:1790784616.162764:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 31 00000100:00100000:2.0:1790784616.162774:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4259360-45b3-4521-b0f8-25fb9487baea+17:14429:x1877773344953856:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:2.0:1790784616.162799:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784616.162818:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4c09 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381354ac expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784616.162905:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4c10 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784616.162917:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4c10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784616.162927:0:14337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4c10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784616.162954:0:14337:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790784616.163076:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4c09 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354ac expref: 20 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784616.163095:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4c10 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354ac expref: 19 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784616.163103:0:14337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94592785a800) 00010000:00010000:2.0:1790784616.163106:0:14337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790784616.163110:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe75c00, rc 0) 00000100:00100000:2.0:1790784616.163168:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4259360-45b3-4521-b0f8-25fb9487baea+19:14429:x1877773344953856:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 396us (3813us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1790784616.163176:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 31 00000100:00100000:0.0:1790784616.169647:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784616.169708:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784616.169931:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344954112 00000100:00100000:3.0:1790784616.169940:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344954112 00000100:00100000:3.0:1790784616.170023:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 0 00000100:00100000:3.0:1790784616.170032:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4259360-45b3-4521-b0f8-25fb9487baea+19:2352:x1877773344954112:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790784616.170047:0:14321:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790784616.170071:0:14321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4c10 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354ac expref: 19 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784616.170092:0:14321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94592785a800) 00010000:00010000:3.0:1790784616.170097:0:14321:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790784616.170147:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4259360-45b3-4521-b0f8-25fb9487baea+18:2352:x1877773344954112:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 116us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784616.170153:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 0 00000100:00100000:2.0:1790784616.170775:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344953984 00000100:00100000:2.0:1790784616.170782:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344953984 00000100:00100000:2.0:1790784616.170813:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 32 00000100:00100000:2.0:1790784616.170821:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4259360-45b3-4521-b0f8-25fb9487baea+18:14429:x1877773344953984:12345-192.168.206.32@tcp:54:lfs.0 00010000:00010000:2.0:1790784616.170874:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4c1e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784616.170888:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4c1e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784616.170898:0:14336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4c1e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784616.170922:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4c1e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784616.170938:0:14336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4c1e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784616.170944:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4c1e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784616.170949:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784616.170955:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4c1e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784616.170962:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4c1e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784616.170971:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94592785a800) 00010000:00010000:2.0:1790784616.170974:0:14336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790784616.170978:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4c1e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784616.170984:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4c1e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784616.171052:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4259360-45b3-4521-b0f8-25fb9487baea+18:14429:x1877773344953984:12345-192.168.206.32@tcp:54:lfs.0 Request processed in 223us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784616.171059:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 32 00000100:00100000:0.0:1790784616.174765:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784616.174911:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344954368 00000100:00100000:1.0:1790784616.174920:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344954368 00000100:00100000:1.0:1790784616.174977:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 7 00000100:00100000:1.0:1790784616.174988:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4259360-45b3-4521-b0f8-25fb9487baea+18:14429:x1877773344954368:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:1.0:1790784616.175236:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4259360-45b3-4521-b0f8-25fb9487baea+19:14429:x1877773344954368:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 249us (478us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1790784616.175243:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 7 00000100:00100000:3.0:1790784616.534608:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784616.534721:0:16214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344954624 00000100:00100000:0.0:1790784616.534730:0:16214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344954624 00000100:00100000:0.0:1790784616.534788:0:16214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 33 00000100:00100000:0.0:1790784616.534797:0:16214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4259360-45b3-4521-b0f8-25fb9487baea+19:14460:x1877773344954624:12345-192.168.206.32@tcp:101:cat.0 00010000:00010000:0.0:1790784616.534833:0:16214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784616.534852:0:16214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945909575400/0x2c3a1e2a079d4c25 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381354b3 expref: -99 pid: 16214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784616.534942:0:16214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945909574400/0x2c3a1e2a079d4c2c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784616.534956:0:16214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945909574400/0x2c3a1e2a079d4c2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784616.534966:0:16214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945909574400/0x2c3a1e2a079d4c2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790784616.534978:0:16214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790784616.535144:0:16214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945909575400/0x2c3a1e2a079d4c25 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354b3 expref: 22 pid: 16214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784616.535162:0:16214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945909574400/0x2c3a1e2a079d4c2c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354b3 expref: 21 pid: 16214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784616.535170:0:16214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94592785a800) 00010000:00010000:0.0:1790784616.535173:0:16214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790784616.535177:0:16214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945909574400, rc 0) 00000100:00100000:0.0:1790784616.535246:0:16214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4259360-45b3-4521-b0f8-25fb9487baea+21:14460:x1877773344954624:12345-192.168.206.32@tcp:101:cat.0 Request processed in 450us (646us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1790784616.535253:0:16214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 33 00000100:00100000:0.0:1790784616.542032:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784616.542169:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344954752 00000100:00100000:2.0:1790784616.542179:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344954752 00000100:00100000:2.0:1790784616.542432:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 1 00000100:00100000:2.0:1790784616.542442:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9459057c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4259360-45b3-4521-b0f8-25fb9487baea+21:2349:x1877773344954752:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790784616.542562:0:14320:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784616.542596:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945909574400/0x2c3a1e2a079d4c2c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354b3 expref: 21 pid: 16214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784616.542614:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94592785a800) 00010000:00010000:2.0:1790784616.542619:0:14320:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790784616.542717:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9459057c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4259360-45b3-4521-b0f8-25fb9487baea+20:2349:x1877773344954752:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 276us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784616.542725:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 1 00000100:00100000:0.0:1790784616.562804:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784616.562925:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344955008 00000100:00100000:1.0:1790784616.562934:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344955008 00000100:00100000:1.0:1790784616.562999:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 8 00000100:00100000:1.0:1790784616.563020:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4259360-45b3-4521-b0f8-25fb9487baea+20:14460:x1877773344955008:12345-192.168.206.32@tcp:35:cat.0 00000100:00100000:1.0:1790784616.563535:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4259360-45b3-4521-b0f8-25fb9487baea+21:14460:x1877773344955008:12345-192.168.206.32@tcp:35:cat.0 Request processed in 515us (739us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1790784616.563545:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 8 00010000:00010000:2.0:1790784616.570785:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784616.665248:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784616.672110:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344955264 00000100:00100000:2.0:1790784616.672126:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344955264 00000100:00100000:2.0:1790784616.672208:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 34 00000100:00100000:2.0:1790784616.672219:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590569ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4259360-45b3-4521-b0f8-25fb9487baea+21:14466:x1877773344955264:12345-192.168.206.32@tcp:101:dd.0 00010000:00010000:2.0:1790784616.672243:0:14336:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784616.672263:0:14336:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4c3a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381354ba expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784616.672356:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4c41 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784616.672371:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4c41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784616.672399:0:14336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4c41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784616.672411:0:14336:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790784616.673096:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4c3a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354ba expref: 24 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784616.673137:0:14336:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4c41 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354ba expref: 23 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784616.673145:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94592785a800) 00010000:00010000:2.0:1790784616.673148:0:14336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790784616.673152:0:14336:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74200, rc 0) 00000100:00100000:2.0:1790784616.673424:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590569ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4259360-45b3-4521-b0f8-25fb9487baea+23:14466:x1877773344955264:12345-192.168.206.32@tcp:101:dd.0 Request processed in 1205us (8182us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1790784616.673432:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 34 00000100:00100000:3.0:1790784616.694102:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784616.694172:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344955520 00000100:00100000:2.0:1790784616.694182:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344955520 00000100:00100000:2.0:1790784616.694252:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 35 00000100:00100000:2.0:1790784616.694263:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4259360-45b3-4521-b0f8-25fb9487baea+23:14466:x1877773344955520:12345-192.168.206.32@tcp:36:dd.0 00010000:00010000:2.0:1790784616.694318:0:14337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1790784616.694345:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4c41 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354ba expref: 23 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784616.694368:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955ec00/0x2c3a1e2a079d4bf4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813549e expref: 22 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784616.694432:0:14337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94592785a800) 00010000:00010000:2.0:1790784616.694438:0:14337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790784616.695021:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4c4f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784616.695037:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4c4f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784616.695060:0:14337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4c4f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790784616.695113:0:14337:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1790784616.695155:0:14337:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd0d084a reply state 0000000008ba7896 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4c4f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784616.695164:0:14337:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790784616.695409:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4259360-45b3-4521-b0f8-25fb9487baea+24:14466:x1877773344955520:12345-192.168.206.32@tcp:36:dd.0 Request processed in 1112us (1282us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1790784616.695417:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 35 00000020:00080000:2.0:1790784616.695422:0:14337:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790784616.703511:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4c4f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784616.703528:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4c4f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784616.703537:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4c4f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784616.703543:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784616.703548:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4c4f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784616.703557:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4c4f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784616.703573:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94592785a800) 00010000:00010000:0.0:1790784616.703576:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784616.703581:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4c4f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784616.703588:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4c4f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784616.816887:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784616.817364:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344955776 00000100:00100000:2.0:1790784616.817419:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344955776 00000100:00100000:2.0:1790784616.817493:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 9 00000100:00100000:2.0:1790784616.817504:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4259360-45b3-4521-b0f8-25fb9487baea+23:14466:x1877773344955776:12345-192.168.206.32@tcp:35:dd.0 00000100:00100000:2.0:1790784616.817720:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4259360-45b3-4521-b0f8-25fb9487baea+24:14466:x1877773344955776:12345-192.168.206.32@tcp:35:dd.0 Request processed in 217us (839us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1790784616.817727:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 9 00000100:00100000:1.0:1790784617.056495:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784617.056855:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344955904 00000100:00100000:2.0:1790784617.056864:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344955904 00000100:00100000:2.0:1790784617.056921:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 36 00000100:00100000:2.0:1790784617.056930:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4259360-45b3-4521-b0f8-25fb9487baea+24:14481:x1877773344955904:12345-192.168.206.32@tcp:101:stat.0 00010000:00010000:2.0:1790784617.056955:0:14336:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784617.056973:0:14336:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4c56 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381354c1 expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.057087:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4c5d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.057102:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4c5d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.057113:0:14336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4c5d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.057126:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4c64 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.057133:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4c64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.057138:0:14336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4c64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.057657:0:14336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4c6b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.057669:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4c6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.057678:0:14336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4c6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784617.057715:0:14336:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1790784617.057720:0:14336:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790784617.057757:0:14336:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4c6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.057780:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4c6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.057789:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4c5d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.057795:0:14336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4c5d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.057801:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4c5d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.057807:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784617.057812:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4c5d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.057820:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4c5d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.057832:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94590345d900) 00010000:00010000:2.0:1790784617.057835:0:14336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784617.057840:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4c5d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.057845:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4c5d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.057859:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4c64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.057865:0:14336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4c64 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.057877:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4c64 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.057883:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74e00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784617.057886:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4c64 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.057893:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4c64 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.057901:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff945903af2200) 00010000:00010000:2.0:1790784617.057904:0:14336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784617.057907:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4c64 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.057914:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4c64 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14336 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.057948:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4c56 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354c1 expref: 26 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.057961:0:14336:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4c6b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354c1 expref: 25 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.057968:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94592785a800) 00010000:00010000:2.0:1790784617.057970:0:14336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790784617.057972:0:14336:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74400, rc 0) 00000100:00100000:2.0:1790784617.059553:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4259360-45b3-4521-b0f8-25fb9487baea+25:14481:x1877773344955904:12345-192.168.206.32@tcp:101:stat.0 Request processed in 2615us (3071us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784617.059579:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 36 00000100:00100000:0.0:1790784617.168830:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784617.168981:0:16214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344956160 00000100:00100000:2.0:1790784617.168990:0:16214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344956160 00000100:00100000:2.0:1790784617.169154:0:16214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 37 00000100:00100000:2.0:1790784617.169165:0:16214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906be9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4259360-45b3-4521-b0f8-25fb9487baea+25:14487:x1877773344956160:12345-192.168.206.32@tcp:36:truncate.0 00010000:00010000:2.0:1790784617.169286:0:16214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784617.169310:0:16214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4c6b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354c1 expref: 25 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.169329:0:16214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94592785a800) 00010000:00010000:2.0:1790784617.169335:0:16214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790784617.169723:0:16214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4c72 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.169736:0:16214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4c72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.169746:0:16214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4c72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790784617.169793:0:16214:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:2.0:1790784617.169815:0:16214:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa985d9a reply state 000000002032ad51 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4c72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784617.169824:0:16214:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790784617.169924:0:16214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906be9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4259360-45b3-4521-b0f8-25fb9487baea+27:14487:x1877773344956160:12345-192.168.206.32@tcp:36:truncate.0 Request processed in 761us (1101us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1790784617.169931:0:16214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 37 00000020:00080000:2.0:1790784617.169947:0:16214:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790784617.180936:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4c72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.180954:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4c72 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.180963:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4c72 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.180970:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74200 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784617.180974:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4c72 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.180982:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4c72 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.181030:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94592785a800) 00010000:00010000:3.0:1790784617.181033:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784617.181053:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4c72 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.181061:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4c72 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784617.424821:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784617.425901:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344956288 00000100:00100000:3.0:1790784617.425912:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344956288 00000100:00100000:3.0:1790784617.425974:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 38 00000100:00100000:3.0:1790784617.425983:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906beaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4259360-45b3-4521-b0f8-25fb9487baea+26:14501:x1877773344956288:12345-192.168.206.32@tcp:101:stat.0 00010000:00010000:3.0:1790784617.426031:0:14335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784617.426058:0:14335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f600/0x2c3a1e2a079d4c79 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381354c8 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.426128:0:14335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e000/0x2c3a1e2a079d4c80 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.426141:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e000/0x2c3a1e2a079d4c80 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.426151:0:14335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e000/0x2c3a1e2a079d4c80 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.426163:0:14335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4c87 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.426170:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4c87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.426193:0:14335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4c87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.426274:0:14335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4c8e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.426282:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4c8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.426289:0:14335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4c8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790784617.426323:0:14335:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:3.0:1790784617.426344:0:14335:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790784617.426368:0:14335:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4c8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.426423:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4c8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.426431:0:14335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e000/0x2c3a1e2a079d4c80 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.426438:0:14335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e000/0x2c3a1e2a079d4c80 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.426445:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e000/0x2c3a1e2a079d4c80 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.426450:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2e000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784617.426455:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e000/0x2c3a1e2a079d4c80 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.426469:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e000/0x2c3a1e2a079d4c80 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.426481:0:14335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94590345d900) 00010000:00010000:3.0:1790784617.426484:0:14335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784617.426489:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e000/0x2c3a1e2a079d4c80 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.426495:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e000/0x2c3a1e2a079d4c80 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.426508:0:14335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4c87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.426514:0:14335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4c87 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.426520:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4c87 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.426525:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2e600 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784617.426528:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4c87 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.426533:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4c87 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.426540:0:14335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff94592785ab00) 00010000:00010000:3.0:1790784617.426542:0:14335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784617.426545:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4c87 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.426560:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4c87 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.426592:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f600/0x2c3a1e2a079d4c79 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354c8 expref: 28 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.426606:0:14335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4c8e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354c8 expref: 27 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.426613:0:14335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94592785a800) 00010000:00010000:3.0:1790784617.426615:0:14335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790784617.426618:0:14335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945802d2f400, rc 0) 00000100:00100000:3.0:1790784617.426687:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906beaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4259360-45b3-4521-b0f8-25fb9487baea+27:14501:x1877773344956288:12345-192.168.206.32@tcp:101:stat.0 Request processed in 705us (1874us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784617.426695:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 38 00000100:00100000:0.0:1790784617.594491:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784617.594939:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344956544 00000100:00100000:1.0:1790784617.594949:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344956544 00000100:00100000:1.0:1790784617.595019:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 39 00000100:00100000:1.0:1790784617.595031:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906bead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4259360-45b3-4521-b0f8-25fb9487baea+27:14511:x1877773344956544:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:1.0:1790784617.595063:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784617.595084:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f600/0x2c3a1e2a079d4c95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381354cf expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790784617.595177:0:14337:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790784617.595286:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f600/0x2c3a1e2a079d4c95 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354cf expref: 29 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784617.595300:0:14337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2a00) 00010000:00010000:1.0:1790784617.595302:0:14337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790784617.595307:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f600/0x2c3a1e2a079d4c95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354cf expref: 29 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784617.595320:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94590955f600, rc 0) 00000100:00100000:1.0:1790784617.595600:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906bead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4259360-45b3-4521-b0f8-25fb9487baea+28:14511:x1877773344956544:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 571us (1117us total) trans 8589934614 rc 301/301 00000100:00100000:1.0:1790784617.595619:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 39 00010000:00010000:2.0:1790784617.597233:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790784617.601489:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784617.603698:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344956800 00000100:00100000:2.0:1790784617.603712:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344956800 00000100:00100000:2.0:1790784617.603774:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 10 00000100:00100000:2.0:1790784617.603785:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945907d33450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4259360-45b3-4521-b0f8-25fb9487baea+28:14511:x1877773344956800:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:2.0:1790784617.604020:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945907d33450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4259360-45b3-4521-b0f8-25fb9487baea+29:14511:x1877773344956800:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 236us (2538us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1790784617.604029:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 10 00000100:00100000:2.0:1790784617.744488:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784617.744562:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344957056 00000100:00100000:3.0:1790784617.744573:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344957056 00000100:00100000:3.0:1790784617.744734:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 40 00000100:00100000:3.0:1790784617.744745:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590685e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4259360-45b3-4521-b0f8-25fb9487baea+29:14517:x1877773344957056:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:3.0:1790784617.744768:0:14335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784617.744789:0:14335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f600/0x2c3a1e2a079d4ca3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381354d6 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.744892:0:14335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4caa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.744906:0:14335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e200/0x2c3a1e2a079d4bdf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135497 expref: 30 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.744928:0:14335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4c8e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354c8 expref: 30 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.744937:0:14335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4caa lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.744971:0:14335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4c8e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381354c8 expref: 30 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.744984:0:14335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4c8e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381354c8 expref: 30 pid: 14335 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784617.745009:0:14335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14335:1877773359619328:192.168.206.32@tcp:104: 00010000:00010000:3.0:1790784617.745114:0:14335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e200/0x2c3a1e2a079d4bdf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135497 expref: 30 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.745123:0:14335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e200/0x2c3a1e2a079d4bdf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135497 expref: 30 pid: 14335 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784617.745132:0:14335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593c29c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14335:1877773359619456:192.168.206.32@tcp:104: 00000100:00100000:3.0:1790784617.745167:0:14335:0:(client.c:2716:ptlrpc_set_wait()) set ffff945906616a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790784617.751278:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784617.751324:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784617.751403:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344957312 00000100:00100000:0.0:1790784617.751411:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344957312 00010000:00010000:0.0:1790784617.751449:0:14320:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e200/0x2c3a1e2a079d4bdf lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135497 expref: 31 pid: 14335 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784617.751503:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344957184 00000100:00100000:0.0:1790784617.751507:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344957184 00010000:00010000:0.0:1790784617.751520:0:14320:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4c8e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381354c8 expref: 32 pid: 14335 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784617.751546:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 11 00000100:00100000:0.0:1790784617.751556:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c289050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4259360-45b3-4521-b0f8-25fb9487baea+32:2351:x1877773344957312:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790784617.751570:0:14320:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784617.751576:0:14320:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e200/0x2c3a1e2a079d4bdf lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135497 expref: 32 pid: 14335 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784617.751587:0:14320:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e200/0x2c3a1e2a079d4bdf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135497 expref: 32 pid: 14335 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784617.751606:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94592785a800) 00010000:00010000:0.0:1790784617.751611:0:14320:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4caa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784617.751697:0:14322:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1790784617.751707:0:14322:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1790784617.751809:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 12 00010000:00010000:0.0:1790784617.751817:0:14320:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4caa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784617.751822:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906bea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4259360-45b3-4521-b0f8-25fb9487baea+32:2351:x1877773344957184:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790784617.751829:0:14320:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790784617.751834:0:14322:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784617.751842:0:14322:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4c8e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381354c8 expref: 32 pid: 14335 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784617.751855:0:14322:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4c8e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381354c8 expref: 32 pid: 14335 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784617.751879:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94592785a800) 00000100:00100000:0.0:1790784617.751881:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c289050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4259360-45b3-4521-b0f8-25fb9487baea+32:2351:x1877773344957312:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 325us (611us total) trans 0 rc 0/0 00010000:00010000:1.0:1790784617.751884:0:14322:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4caa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784617.751895:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 11 00010000:00010000:1.0:1790784617.751898:0:14322:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4caa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784617.751907:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4caa lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784617.751929:0:14322:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790784617.751957:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906bea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4259360-45b3-4521-b0f8-25fb9487baea+31:2351:x1877773344957184:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 137us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784617.751965:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 12 00010000:00010000:3.0:1790784617.752344:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4c8e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381354c8 expref: 30 pid: 14335 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784617.752358:0:14335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14335:1877773359619328:192.168.206.32@tcp:104: 00010000:00010000:3.0:1790784617.752439:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e200/0x2c3a1e2a079d4bdf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135497 expref: 29 pid: 14335 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784617.752451:0:14335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593c29c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14335:1877773359619456:192.168.206.32@tcp:104: 00010000:00010000:3.0:1790784617.752471:0:14335:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4caa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.752480:0:14335:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4caa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.752486:0:14335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4caa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790784617.752512:0:14335:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1790784617.752663:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f600/0x2c3a1e2a079d4ca3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354d6 expref: 30 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.752679:0:14335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4caa lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354d6 expref: 29 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.752686:0:14335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94592785a800) 00010000:00010000:3.0:1790784617.752688:0:14335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790784617.752690:0:14335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945802d2e600, rc 0) 00000100:00100000:3.0:1790784617.752734:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590685e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4259360-45b3-4521-b0f8-25fb9487baea+29:14517:x1877773344957056:12345-192.168.206.32@tcp:101:bash.0 Request processed in 7991us (8253us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1790784617.752741:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 40 00000100:00100000:3.0:1790784617.761479:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784617.763197:0:16214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344957568 00000100:00100000:2.0:1790784617.763210:0:16214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344957568 00000100:00100000:2.0:1790784617.763291:0:16214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 41 00000100:00100000:2.0:1790784617.763301:0:16214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4259360-45b3-4521-b0f8-25fb9487baea+29:14517:x1877773344957568:12345-192.168.206.32@tcp:36:bash.0 00010000:00010000:2.0:1790784617.763849:0:16214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4cb8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.763865:0:16214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4cb8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.763877:0:16214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4cb8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790784617.763930:0:16214:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1790784617.763973:0:16214:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e70fe4b0 reply state 000000007de1fdc9 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4cb8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784617.763982:0:16214:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790784617.764086:0:16214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4259360-45b3-4521-b0f8-25fb9487baea+32:14517:x1877773344957568:12345-192.168.206.32@tcp:36:bash.0 Request processed in 785us (2615us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1790784617.764114:0:16214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 41 00000020:00080000:2.0:1790784617.764120:0:16214:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790784617.769738:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4cb8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.769767:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4cb8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.769775:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4cb8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.769781:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74e00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784617.769785:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4cb8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.769793:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4cb8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.769808:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94592785a800) 00010000:00010000:3.0:1790784617.769811:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784617.769815:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4cb8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784617.769822:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4cb8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784617.779701:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784617.781013:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344957696 00000100:00100000:2.0:1790784617.781025:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344957696 00000100:00100000:2.0:1790784617.781090:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 42 00000100:00100000:2.0:1790784617.781102:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4259360-45b3-4521-b0f8-25fb9487baea+31:14517:x1877773344957696:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:2.0:1790784617.781125:0:14336:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784617.781146:0:14336:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4cbf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381354dd expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.781206:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4cbf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354dd expref: 32 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.781221:0:14336:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4cbf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354dd expref: 32 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.781341:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94592785a800) 00010000:00010000:2.0:1790784617.781345:0:14336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790784617.781349:0:14336:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe75000, rc 0) 00000100:00100000:2.0:1790784617.781748:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4259360-45b3-4521-b0f8-25fb9487baea+32:14517:x1877773344957696:12345-192.168.206.32@tcp:101:bash.0 Request processed in 647us (2053us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784617.781755:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 42 00000100:00100000:1.0:1790784617.799523:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784617.799636:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344957824 00000100:00100000:2.0:1790784617.799646:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344957824 00000100:00100000:2.0:1790784617.799704:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 43 00000100:00100000:2.0:1790784617.799714:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4259360-45b3-4521-b0f8-25fb9487baea+32:14517:x1877773344957824:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:2.0:1790784617.799742:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784617.799762:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4cc6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381354e4 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.799851:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4ccd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.799865:0:14337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4caa lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354d6 expref: 33 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.799874:0:14337:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4ccd lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.799902:0:14337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4caa lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381354d6 expref: 33 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.799914:0:14337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4caa lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381354d6 expref: 33 pid: 14335 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784617.799927:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590685ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14337:1877773359619584:192.168.206.32@tcp:104: 00000100:00100000:2.0:1790784617.800010:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910384840 going to sleep for 11 seconds 00000100:00100000:2.0:1790784617.804614:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590685ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14337:1877773359619584:192.168.206.32@tcp:104: 00010000:00010000:2.0:1790784617.804642:0:14337:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4ccd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784617.804882:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784617.804957:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344957952 00000100:00100000:2.0:1790784617.804965:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344957952 00010000:00010000:2.0:1790784617.805010:0:14320:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4caa lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381354d6 expref: 34 pid: 14335 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784617.805067:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 13 00000100:00100000:2.0:1790784617.805077:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906be9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4259360-45b3-4521-b0f8-25fb9487baea+34:2352:x1877773344957952:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790784617.805092:0:14320:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784617.805099:0:14320:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4caa lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381354d6 expref: 34 pid: 14335 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.805110:0:14320:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4caa lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381354d6 expref: 34 pid: 14335 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.805130:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e600/0x2c3a1e2a079d4caa lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.32@tcp remote: 0x394e0d88381354d6 expref: 34 pid: 14335 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.805144:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94592785a800) 00010000:00010000:2.0:1790784617.805148:0:14320:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4ccd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.805157:0:14320:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4ccd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.805163:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4ccd lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.805455:0:14320:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790784617.805509:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906be9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4259360-45b3-4521-b0f8-25fb9487baea+33:2352:x1877773344957952:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 433us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784617.805516:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 13 00010000:00010000:1.0:1790784617.805572:0:14337:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4ccd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784617.805580:0:14337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4ccd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790784617.805620:0:14337:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1790784617.805624:0:14337:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790784617.805642:0:14337:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4ccd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784617.805670:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4cc6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354e4 expref: 33 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784617.805686:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4ccd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354e4 expref: 32 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784617.805693:0:14337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94592785a800) 00010000:00010000:1.0:1790784617.805695:0:14337:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790784617.805697:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe74e00, rc 0) 00000100:00100000:1.0:1790784617.805722:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4259360-45b3-4521-b0f8-25fb9487baea+32:14517:x1877773344957824:12345-192.168.206.32@tcp:101:bash.0 Request processed in 6011us (6209us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784617.805729:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 43 00000100:00100000:3.0:1790784617.809160:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784617.809364:0:16567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344958208 00000100:00100000:0.0:1790784617.809418:0:16567:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344958208 00000100:00100000:0.0:1790784617.809480:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 2 00000100:00100000:0.0:1790784617.809490:0:16567:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4259360-45b3-4521-b0f8-25fb9487baea+32:14517:x1877773344958208:12345-192.168.206.32@tcp:103:bash.0 00010000:00010000:0.0:1790784617.809504:0:16567:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1790784617.809525:0:16567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4ccd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354e4 expref: 32 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784617.809546:0:16567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4cbf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354dd expref: 31 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784617.809557:0:16567:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff94592785a800) 00010000:00010000:0.0:1790784617.809567:0:16567:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790784617.809614:0:16567:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4259360-45b3-4521-b0f8-25fb9487baea+30:14517:x1877773344958208:12345-192.168.206.32@tcp:103:bash.0 Request processed in 126us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784617.809621:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 2 00000100:00100000:3.0:1790784617.811912:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784617.811992:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344958336 00000100:00100000:2.0:1790784617.812022:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344958336 00000100:00100000:2.0:1790784617.812085:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 44 00000100:00100000:2.0:1790784617.812094:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4259360-45b3-4521-b0f8-25fb9487baea+30:14517:x1877773344958336:12345-192.168.206.32@tcp:58:bash.0 00010000:00010000:2.0:1790784617.812192:0:14335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4cd4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.812209:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4cd4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784617.812222:0:14335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4cd4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790784617.812860:0:14335:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790784617.813026:0:14335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1790784617.813091:0:14335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1790784617.813177:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4259360-45b3-4521-b0f8-25fb9487baea+30:14517:x1877773344958336:12345-192.168.206.32@tcp:58:bash.0 Request processed in 1083us (1270us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784617.813186:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 44 00000100:00100000:1.0:1790784617.816302:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784617.816396:0:16214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344958464 00000100:00100000:0.0:1790784617.816404:0:16214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344958464 00000100:00100000:0.0:1790784617.816455:0:16214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 45 00000100:00100000:0.0:1790784617.816464:0:16214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4259360-45b3-4521-b0f8-25fb9487baea+30:14517:x1877773344958464:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:0.0:1790784617.816482:0:16214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784617.816502:0:16214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945909574e00/0x2c3a1e2a079d4cdb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381354eb expref: -99 pid: 16214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784617.816551:0:16214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4cd4 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784617.816562:0:16214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945909574e00/0x2c3a1e2a079d4cdb lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354eb expref: 31 pid: 16214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784617.816597:0:16214:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4cd4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784617.816609:0:16214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945909574e00/0x2c3a1e2a079d4cdb lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354eb expref: 31 pid: 16214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784617.816622:0:16214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff945903af2200) 00010000:00010000:0.0:1790784617.816625:0:16214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790784617.816628:0:16214:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945909574e00/0x2c3a1e2a079d4cdb lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354eb expref: 31 pid: 16214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784617.816636:0:16214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945909574e00, rc 0) 00000100:00100000:0.0:1790784617.816691:0:16214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4259360-45b3-4521-b0f8-25fb9487baea+31:14517:x1877773344958464:12345-192.168.206.32@tcp:101:bash.0 Request processed in 228us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784617.816698:0:16214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 45 00000100:00100000:1.0:1790784617.914836:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590685ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359619712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790784617.914903:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784617.915122:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359619712 00000100:00100000:2.0:1790784617.915130:0:15024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359619712 00000100:00100000:2.0:1790784617.915196:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790784617.915206:0:15024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359619712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790784617.915252:0:15024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790784617.915300:0:15024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1877773359619712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784617.915307:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790784617.915356:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590685ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359619712:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790784617.915551:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1790784617.973422:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934606 is committed 00000001:00080000:1.0:1790784617.973448:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:1.0:1790784617.973471:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:1.0:1790784617.973494:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934618 is committed 00000040:00080000:1.0:1790784618.170597:0:14368:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790784618.170607:0:14368:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790784618.170664:0:14368:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1790784618.170672:0:14368:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1790784618.171059:0:14368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d221880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14368:1877773359619840:192.168.206.32@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790784618.171234:0:14368:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910ff8000 going to sleep for 11 seconds 00000100:00100000:1.0:1790784618.179088:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784618.179165:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344958592 00000100:00100000:0.0:1790784618.179174:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344958592 00000100:00100000:2.0:1790784618.179188:0:14368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d221880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14368:1877773359619840:192.168.206.32@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790784618.179259:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 0 00000100:00100000:0.0:1790784618.179267:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f4259360-45b3-4521-b0f8-25fb9487baea+10:14518:x1877773344958592:12345-192.168.206.32@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1790784618.179331:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f4259360-45b3-4521-b0f8-25fb9487baea+10:14518:x1877773344958592:12345-192.168.206.32@tcp:900:lhsmtool_posix.0 Request processed in 64us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784618.179338:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 0 00000100:00080000:1.0:1790784618.179566:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790784618.187075:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784618.187149:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344958720 00000100:00100000:2.0:1790784618.187158:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344958720 00000100:00100000:2.0:1790784618.187222:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 46 00000100:00100000:2.0:1790784618.187233:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4259360-45b3-4521-b0f8-25fb9487baea+10:14518:x1877773344958720:12345-192.168.206.32@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790784618.187263:0:14335:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790784618.187398:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4259360-45b3-4521-b0f8-25fb9487baea+10:14518:x1877773344958720:12345-192.168.206.32@tcp:53:lhsmtool_posix.0 Request processed in 142us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784618.187407:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 46 00000100:00100000:0.0:1790784618.205413:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784618.206053:0:16214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344958848 00000100:00100000:2.0:1790784618.206063:0:16214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344958848 00000100:00100000:2.0:1790784618.206124:0:16214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 47 00000100:00100000:2.0:1790784618.206134:0:16214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906be9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4259360-45b3-4521-b0f8-25fb9487baea+10:14518:x1877773344958848:12345-192.168.206.32@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790784618.206210:0:16214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4ce2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.206236:0:16214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4ce2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.206250:0:16214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4ce2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.206266:0:16214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4ce9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.206274:0:16214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4ce9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.206280:0:16214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4ce9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.206322:0:16214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4cf0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.206330:0:16214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.206337:0:16214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784618.206371:0:16214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1790784618.206403:0:16214:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790784618.206418:0:16214:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.206429:0:16214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4ce2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.206436:0:16214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4ce2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.206442:0:16214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4ce2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.206448:0:16214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74200 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784618.206452:0:16214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4ce2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.206460:0:16214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4ce2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.206471:0:16214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94590345d300) 00010000:00010000:2.0:1790784618.206479:0:16214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784618.206484:0:16214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4ce2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.206491:0:16214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74200/0x2c3a1e2a079d4ce2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.206506:0:16214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4ce9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.206512:0:16214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4ce9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.206517:0:16214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4ce9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.206522:0:16214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784618.206525:0:16214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4ce9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.206531:0:16214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4ce9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.206539:0:16214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff945903af2700) 00010000:00010000:2.0:1790784618.206541:0:16214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784618.206544:0:16214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4ce9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.206550:0:16214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75000/0x2c3a1e2a079d4ce9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.206566:0:16214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.206579:0:16214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4cf0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.206585:0:16214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4cf0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.206590:0:16214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74e00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784618.206593:0:16214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4cf0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.206599:0:16214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4cf0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.206607:0:16214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff945903af2200) 00010000:00010000:2.0:1790784618.206609:0:16214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784618.206612:0:16214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4cf0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.206618:0:16214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74e00/0x2c3a1e2a079d4cf0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784618.206701:0:16214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906be9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4259360-45b3-4521-b0f8-25fb9487baea+10:14518:x1877773344958848:12345-192.168.206.32@tcp:34:lhsmtool_posix.0 Request processed in 567us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784618.206709:0:16214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 47 00000100:00100000:0.0:1790784618.212453:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784618.212667:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344959104 00000100:00100000:2.0:1790784618.212677:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344959104 00000100:00100000:2.0:1790784618.212734:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 48 00000100:00100000:2.0:1790784618.212745:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906be9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4259360-45b3-4521-b0f8-25fb9487baea+10:14518:x1877773344959104:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790784618.212763:0:14335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784618.212802:0:14335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4cf7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381354f2 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.212895:0:14335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030800/0x2c3a1e2a079d4cfe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.212909:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900030800/0x2c3a1e2a079d4cfe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.212922:0:14335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030800/0x2c3a1e2a079d4cfe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790784618.212933:0:14335:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790784618.213060:0:14335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030800/0x2c3a1e2a079d4cfe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.213068:0:14335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900030800/0x2c3a1e2a079d4cfe lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.213074:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945900030800/0x2c3a1e2a079d4cfe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.213080:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784618.213084:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030800/0x2c3a1e2a079d4cfe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.213091:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030800/0x2c3a1e2a079d4cfe lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.213102:0:14335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff945903af2200) 00010000:00010000:2.0:1790784618.213105:0:14335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790784618.213109:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945900030800/0x2c3a1e2a079d4cfe lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.213124:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030800/0x2c3a1e2a079d4cfe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.213160:0:14335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4cf7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354f2 expref: 12 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.213169:0:14335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94590345d300) 00010000:00010000:2.0:1790784618.213171:0:14335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790784618.213175:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4cf7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354f2 expref: 12 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.213184:0:14335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94593fe75c00, rc 0) 00000100:00100000:2.0:1790784618.213244:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906be9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4259360-45b3-4521-b0f8-25fb9487baea+11:14518:x1877773344959104:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 502us (800us total) trans 8589934619 rc 301/301 00000100:00100000:2.0:1790784618.213251:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 48 00000100:00100000:0.0:1790784618.218161:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784618.218256:0:16214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344959232 00000100:00100000:2.0:1790784618.218265:0:16214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344959232 00000100:00100000:2.0:1790784618.218323:0:16214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 49 00000100:00100000:2.0:1790784618.218332:0:16214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4259360-45b3-4521-b0f8-25fb9487baea+11:14518:x1877773344959232:12345-192.168.206.32@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790784618.218366:0:16214:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790784618.218508:0:16214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4259360-45b3-4521-b0f8-25fb9487baea+11:14518:x1877773344959232:12345-192.168.206.32@tcp:53:lhsmtool_posix.0 Request processed in 176us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784618.218516:0:16214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 49 00000100:00100000:0.0:1790784618.222322:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784618.222705:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344959488 00000100:00100000:2.0:1790784618.222714:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344959488 00000100:00100000:2.0:1790784618.222771:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 50 00000100:00100000:2.0:1790784618.222803:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4259360-45b3-4521-b0f8-25fb9487baea+11:14518:x1877773344959488:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790784618.222823:0:14335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784618.222842:0:14335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030800/0x2c3a1e2a079d4d0c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d88381354f9 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790784618.223547:0:14335:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:2.0:1790784618.223555:0:14335:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1790784618.223598:0:14335:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1790784618.223856:0:14335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4d13 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.223870:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4d13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.223882:0:14335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4d13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.223939:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030800/0x2c3a1e2a079d4d0c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354f9 expref: 14 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.223956:0:14335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4d13 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354f9 expref: 13 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.223964:0:14335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff945903af2700) 00010000:00010000:2.0:1790784618.223967:0:14335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790784618.223971:0:14335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945900031800, rc 0) 00000100:00100000:2.0:1790784618.224034:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4259360-45b3-4521-b0f8-25fb9487baea+13:14518:x1877773344959488:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 1233us (1720us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1790784618.224042:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 50 00000100:00100000:0.0:1790784618.233209:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784618.233344:0:16214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344959744 00000100:00100000:2.0:1790784618.233353:0:16214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344959744 00000100:00100000:2.0:1790784618.233448:0:16214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 51 00000100:00100000:2.0:1790784618.233459:0:16214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906beb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4259360-45b3-4521-b0f8-25fb9487baea+13:14518:x1877773344959744:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790784618.233513:0:16214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790784618.233538:0:16214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900031800/0x2c3a1e2a079d4d13 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354f9 expref: 13 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.233556:0:16214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff945903af2700) 00010000:00010000:2.0:1790784618.233567:0:16214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790784618.233586:0:16214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030800/0x2c3a1e2a079d4d21 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.233599:0:16214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900030800/0x2c3a1e2a079d4d21 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.233609:0:16214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030800/0x2c3a1e2a079d4d21 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.233651:0:16214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4d28 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x241dded2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.233660:0:16214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4d28 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x241dded2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.233667:0:16214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4d28 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x241dded2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.233864:0:16214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030800/0x2c3a1e2a079d4d21 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.233883:0:16214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900030800/0x2c3a1e2a079d4d21 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.233890:0:16214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945900030800/0x2c3a1e2a079d4d21 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.233896:0:16214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784618.233900:0:16214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030800/0x2c3a1e2a079d4d21 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.233907:0:16214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030800/0x2c3a1e2a079d4d21 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.233916:0:16214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94590345d900) 00010000:00010000:2.0:1790784618.233919:0:16214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784618.233922:0:16214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945900030800/0x2c3a1e2a079d4d21 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.233929:0:16214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030800/0x2c3a1e2a079d4d21 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.233945:0:16214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4d28 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x241dded2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.233951:0:16214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4d28 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x241dded2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.233957:0:16214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4d28 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x241dded2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.233962:0:16214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030e00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:2.0:1790784618.233973:0:16214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4d28 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x241dded2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.233979:0:16214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4d28 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x241dded2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.233986:0:16214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x241dded2 (ffff945903af2600) 00010000:00010000:2.0:1790784618.233989:0:16214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790784618.234002:0:16214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4d28 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x241dded2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.234009:0:16214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4d28 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x241dded2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784618.234128:0:16214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906beb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4259360-45b3-4521-b0f8-25fb9487baea+12:14518:x1877773344959744:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 Request processed in 671us (927us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790784618.234136:0:16214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 51 00000100:00100000:0.0:1790784618.240637:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784618.240706:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344959872 00000100:00100000:2.0:1790784618.240715:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344959872 00000100:00100000:2.0:1790784618.240769:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 52 00000100:00100000:2.0:1790784618.240787:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906be8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4259360-45b3-4521-b0f8-25fb9487baea+12:14518:x1877773344959872:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790784618.240807:0:14335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784618.240829:0:14335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4d2f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135500 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.240859:0:14335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d4d36 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.240872:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d4d36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.240898:0:14335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d4d36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.241028:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4d2f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135500 expref: 14 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.241060:0:14335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030c00/0x2c3a1e2a079d4d36 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135500 expref: 13 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.241068:0:14335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff945903af2b00) 00010000:00010000:2.0:1790784618.241071:0:14335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790784618.241075:0:14335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945900030c00, rc 0) 00000100:00100000:2.0:1790784618.241129:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906be8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4259360-45b3-4521-b0f8-25fb9487baea+13:14518:x1877773344959872:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 344us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784618.241137:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 52 00000100:00100000:0.0:1790784618.247692:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784618.252686:0:16214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344960128 00000100:00100000:2.0:1790784618.252701:0:16214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344960128 00000100:00100000:0.0:1790784618.254453:0:16214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 53 00000100:00100000:0.0:1790784618.254467:0:16214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4259360-45b3-4521-b0f8-25fb9487baea+13:14518:x1877773344960128:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790784618.254547:0:16214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945909575200/0x2c3a1e2a079d4d3d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.254563:0:16214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945909575200/0x2c3a1e2a079d4d3d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.254585:0:16214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945909575200/0x2c3a1e2a079d4d3d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790784618.254980:0:16214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1790784618.254991:0:16214:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 452404614782ns, next at 453404612427ns, rc = 0 00000004:00010000:0.0:1790784618.255367:0:16214:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d154945 reply state 000000004946b813 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff945909575200/0x2c3a1e2a079d4d3d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784618.255406:0:16214:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790784618.255497:0:16214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4259360-45b3-4521-b0f8-25fb9487baea+15:14518:x1877773344960128:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 Request processed in 1031us (7812us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1790784618.255504:0:16214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 53 00010000:00010000:3.0:1790784618.261033:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945909575200/0x2c3a1e2a079d4d3d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784618.261049:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945909575200/0x2c3a1e2a079d4d3d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784618.261073:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945909575200/0x2c3a1e2a079d4d3d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784618.261080:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945909575200 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784618.261085:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945909575200/0x2c3a1e2a079d4d3d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784618.261094:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945909575200/0x2c3a1e2a079d4d3d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784618.261120:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff945903af2b00) 00010000:00010000:3.0:1790784618.261124:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790784618.261128:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945909575200/0x2c3a1e2a079d4d3d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784618.261135:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945909575200/0x2c3a1e2a079d4d3d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784618.261184:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784618.261288:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344960256 00000100:00100000:2.0:1790784618.261297:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344960256 00000100:00100000:2.0:1790784618.261348:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 54 00000100:00100000:2.0:1790784618.261358:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4259360-45b3-4521-b0f8-25fb9487baea+14:14518:x1877773344960256:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790784618.261402:0:14335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784618.261419:0:14335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4d44 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135507 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.261484:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4d44 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135507 expref: 15 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.261511:0:14335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4d44 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135507 expref: 15 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.261531:0:14335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff945903af2b00) 00010000:00010000:2.0:1790784618.261534:0:14335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790784618.261536:0:14335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945900030000, rc 0) 00000100:00100000:2.0:1790784618.261580:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4259360-45b3-4521-b0f8-25fb9487baea+15:14518:x1877773344960256:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 224us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784618.261587:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 54 00000100:00100000:1.0:1790784618.271151:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784618.271251:0:15020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344960384 00000100:00100000:2.0:1790784618.271261:0:15020:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344960384 00000100:00100000:2.0:1790784618.271402:0:15020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 12 00000100:00100000:2.0:1790784618.271415:0:15020:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4259360-45b3-4521-b0f8-25fb9487baea+5:2352:x1877773344960384:12345-192.168.206.32@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1790784618.271753:0:15020:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4259360-45b3-4521-b0f8-25fb9487baea+6:2352:x1877773344960384:12345-192.168.206.32@tcp:2:lhsmtool_posix.0 Request processed in 341us (610us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1790784618.271762:0:15020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 12 00000100:00080000:1.0:1790784618.272339:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790784618.280613:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784618.280920:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344960640 00000100:00100000:2.0:1790784618.280929:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344960640 00000100:00100000:2.0:1790784618.281002:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 11 00000100:00100000:2.0:1790784618.281013:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4259360-45b3-4521-b0f8-25fb9487baea+15:14518:x1877773344960640:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790784618.282069:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4259360-45b3-4521-b0f8-25fb9487baea+16:14518:x1877773344960640:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 Request processed in 1053us (1460us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1790784618.282079:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 11 00000100:00100000:3.0:1790784618.288851:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784618.288957:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344960896 00000100:00100000:1.0:1790784618.288965:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344960896 00000100:00100000:1.0:1790784618.289053:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 55 00000100:00100000:1.0:1790784618.289062:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4259360-45b3-4521-b0f8-25fb9487baea+16:14518:x1877773344960896:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790784618.289163:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4259360-45b3-4521-b0f8-25fb9487baea+16:14518:x1877773344960896:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 Request processed in 102us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784618.289170:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 55 00000100:00100000:2.0:1790784618.292848:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784618.292932:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344961024 00000100:00100000:3.0:1790784618.292941:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344961024 00000100:00100000:3.0:1790784618.293179:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 56 00000100:00100000:3.0:1790784618.293189:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590685ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4259360-45b3-4521-b0f8-25fb9487baea+16:14518:x1877773344961024:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790784618.293572:0:14335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790784618.293593:0:14335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f600/0x2c3a1e2a079d4d4b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813550e expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784618.293658:0:14335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e200/0x2c3a1e2a079d4d52 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784618.293683:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e200/0x2c3a1e2a079d4d52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784618.293694:0:14335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e200/0x2c3a1e2a079d4d52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790784618.293728:0:14335:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790784618.293849:0:14335:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e200/0x2c3a1e2a079d4d52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.293877:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f600/0x2c3a1e2a079d4d4b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813550e expref: 18 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.293901:0:14335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e200/0x2c3a1e2a079d4d52 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813550e expref: 17 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.293909:0:14335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff945903af2b00) 00010000:00010000:2.0:1790784618.293912:0:14335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790784618.293915:0:14335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945802d2e200, rc 0) 00000100:00100000:2.0:1790784618.294252:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590685ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4259360-45b3-4521-b0f8-25fb9487baea+17:14518:x1877773344961024:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 1055us (1403us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784618.294260:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 56 00000100:00100000:3.0:1790784618.298013:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784618.298236:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344961152 00000100:00100000:1.0:1790784618.298252:0:15022:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344961152 00000100:00100000:1.0:1790784618.298578:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 13 00000100:00100000:1.0:1790784618.298589:0:15022:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593c29c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4259360-45b3-4521-b0f8-25fb9487baea+6:2352:x1877773344961152:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790784618.298621:0:15022:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784618.298640:0:15022:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da56b57f/0x2c3a1e2a079d4d59 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135515 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790784618.298665:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abd346a, blocks: 0x1 00010000:00010000:1.0:1790784618.298684:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1790784618.298689:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784618.298698:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da56b57f/0x2c3a1e2a079d4d59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135515 expref: 7 pid: 15022 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784618.298714:0:15022:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000da56b57f/0x2c3a1e2a079d4d59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135515 expref: 7 pid: 15022 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784618.298727:0:15022:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94590955f400, rc 0) 00000100:00100000:1.0:1790784618.298828:0:15022:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593c29c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4259360-45b3-4521-b0f8-25fb9487baea+7:2352:x1877773344961152:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 242us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784618.298836:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 13 00000100:00100000:2.0:1790784618.304708:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784618.304930:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344961408 00000100:00100000:1.0:1790784618.304939:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344961408 00000100:00100000:0.0:1790784618.305012:0:16214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 57 00000100:00100000:0.0:1790784618.305025:0:16214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590685c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4259360-45b3-4521-b0f8-25fb9487baea+17:14518:x1877773344961408:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790784618.305133:0:16214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590685c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4259360-45b3-4521-b0f8-25fb9487baea+17:14518:x1877773344961408:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 Request processed in 112us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784618.305159:0:16214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 57 00000100:00100000:3.0:1790784618.309454:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784618.309552:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344961536 00000100:00100000:1.0:1790784618.309561:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344961536 00000100:00100000:1.0:1790784618.309617:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 58 00000100:00100000:1.0:1790784618.309626:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4259360-45b3-4521-b0f8-25fb9487baea+17:14518:x1877773344961536:12345-192.168.206.32@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1790784618.362180:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934621 is committed 00000004:00080000:0.0:1790784618.362189:0:5841:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1790784618.362209:0:5841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000100:00100000:1.0:1790784618.362506:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590685c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359619968:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1790784618.362571:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784618.362640:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359619968 00000100:00100000:0.0:1790784618.362648:0:15021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359619968 00000100:00100000:0.0:1790784618.362713:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790784618.362723:0:15021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1877773359619968:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1790784618.362882:0:15021:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1790784618.362886:0:15021:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1790784618.362888:0:15021:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790784618.362890:0:15021:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1790784618 -> 1790784618 00002000:00010000:0.0:1790784618.362893:0:15021:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1790784618.362932:0:15021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3280:x1877773359619968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 211us (360us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1790784618.362939:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1790784618.363498:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1790784618.363534:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94590685c000/2, rc 0, transno 8589934595 00000100:00100000:1.0:1790784618.363541:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590685c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3280:1877773359619968:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1790784618.363708:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4259360-45b3-4521-b0f8-25fb9487baea+13:14518:x1877773344961536:12345-192.168.206.32@tcp:44:lhsmtool_posix.0 Request processed in 54081us (54260us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784618.363717:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 58 00000100:00100000:3.0:1790784618.366086:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784618.366617:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344961664 00000100:00100000:1.0:1790784618.366626:0:15022:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344961664 00000100:00100000:1.0:1790784618.366669:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 15 00000100:00100000:1.0:1790784618.366683:0:15022:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4259360-45b3-4521-b0f8-25fb9487baea+7:2352:x1877773344961664:12345-192.168.206.32@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1790784618.366895:0:15022:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4259360-45b3-4521-b0f8-25fb9487baea+7:2352:x1877773344961664:12345-192.168.206.32@tcp:16:lhsmtool_posix.0 Request processed in 216us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784618.366903:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 15 00000100:00100000:3.0:1790784618.374230:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784618.374644:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344961920 00000100:00100000:1.0:1790784618.374653:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344961920 00000100:00100000:1.0:1790784618.374739:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 59 00000100:00100000:1.0:1790784618.374749:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4259360-45b3-4521-b0f8-25fb9487baea+13:14518:x1877773344961920:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790784618.374794:0:14337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784618.374815:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e200/0x2c3a1e2a079d4d52 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813550e expref: 13 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784618.374834:0:14337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff945903af2b00) 00010000:00010000:1.0:1790784618.374839:0:14337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790784618.374867:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955fc00/0x2c3a1e2a079d4d60 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784618.374881:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94590955fc00/0x2c3a1e2a079d4d60 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784618.374891:0:14337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955fc00/0x2c3a1e2a079d4d60 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790784618.375085:0:14337:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a51ee7d6 reply state 0000000016c60e28 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff94590955fc00/0x2c3a1e2a079d4d60 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784618.375094:0:14337:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790784618.375177:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4259360-45b3-4521-b0f8-25fb9487baea+14:14518:x1877773344961920:12345-192.168.206.32@tcp:36:lhsmtool_posix.0 Request processed in 428us (954us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1790784618.375184:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 59 00010000:00010000:0.0:1790784618.380164:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955fc00/0x2c3a1e2a079d4d60 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.380181:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94590955fc00/0x2c3a1e2a079d4d60 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.380189:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94590955fc00/0x2c3a1e2a079d4d60 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.380196:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94590955fc00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784618.380200:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955fc00/0x2c3a1e2a079d4d60 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.380225:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94590955fc00/0x2c3a1e2a079d4d60 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.380242:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff945903af2b00) 00010000:00010000:0.0:1790784618.380245:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784618.380260:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94590955fc00/0x2c3a1e2a079d4d60 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.380268:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955fc00/0x2c3a1e2a079d4d60 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14337 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784618.382158:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784618.382693:0:15020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344962048 00000100:00100000:2.0:1790784618.382703:0:15020:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344962048 00000100:00100000:2.0:1790784618.382749:0:15020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 16 00000100:00100000:2.0:1790784618.382758:0:15020:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4259360-45b3-4521-b0f8-25fb9487baea+7:14518:x1877773344962048:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790784618.382775:0:15020:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790784618.382792:0:15020:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d4d67 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813551c expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.382822:0:15020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000da56b57f/0x2c3a1e2a079d4d59 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135515 expref: 8 pid: 15022 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.382842:0:15020:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790784618.382847:0:15020:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790784618.382853:0:15020:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d4d67 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813551c expref: 8 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.382904:0:15020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000da56b57f/0x2c3a1e2a079d4d59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135515 expref: 8 pid: 15022 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.382918:0:15020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000da56b57f/0x2c3a1e2a079d4d59 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135515 expref: 8 pid: 15022 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784618.382932:0:15020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590685fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15020:1877773359620096:192.168.206.32@tcp:104: 00000100:00100000:2.0:1790784618.383037:0:15020:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592d92b600 going to sleep for 11 seconds 00000100:00100000:2.0:1790784618.388595:0:15020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590685fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15020:1877773359620096:192.168.206.32@tcp:104: 00010000:00010000:2.0:1790784618.388633:0:15020:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d4d67 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.32@tcp remote: 0x394e0d883813551c expref: 8 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.388653:0:15020:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945900031800, rc 0) 00000100:00100000:2.0:1790784618.388713:0:15020:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4259360-45b3-4521-b0f8-25fb9487baea+8:14518:x1877773344962048:12345-192.168.206.32@tcp:101:lhsmtool_posix.0 Request processed in 5956us (6564us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784618.388722:0:15020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 16 00000100:00100000:3.0:1790784618.395721:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784618.396146:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344962176 00000100:00100000:1.0:1790784618.396155:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344962176 00010000:00010000:1.0:1790784618.396208:0:14322:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000da56b57f/0x2c3a1e2a079d4d59 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135515 expref: 8 pid: 15022 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784618.396257:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 14 00000100:00100000:1.0:1790784618.396267:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f497480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4259360-45b3-4521-b0f8-25fb9487baea+8:2352:x1877773344962176:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790784618.396281:0:14322:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790784618.396304:0:14322:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000da56b57f/0x2c3a1e2a079d4d59 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135515 expref: 8 pid: 15022 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784618.396317:0:14322:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000da56b57f/0x2c3a1e2a079d4d59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135515 expref: 8 pid: 15022 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784618.396339:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da56b57f/0x2c3a1e2a079d4d59 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135515 expref: 8 pid: 15022 timeout: 552 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784618.396357:0:14322:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784618.396420:0:14322:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790784618.396428:0:14322:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d4d67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.32@tcp remote: 0x394e0d883813551c expref: 7 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784618.396439:0:14322:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d4d67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.32@tcp remote: 0x394e0d883813551c expref: 7 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784618.396478:0:14322:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d4d67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.32@tcp remote: 0x394e0d883813551c expref: 7 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784618.396493:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d220e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14322:1877773359620224:192.168.206.32@tcp:105: 00000100:00100000:1.0:1790784618.396814:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910ff8240 going to sleep for 11 seconds 00000100:00100000:3.0:1790784618.401492:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784618.401627:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344962304 00000100:00100000:0.0:1790784618.401636:0:15022:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344962304 00000100:00100000:0.0:1790784618.401691:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 17 00000100:00100000:0.0:1790784618.401700:0:15022:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4259360-45b3-4521-b0f8-25fb9487baea+8:2352:x1877773344962304:12345-192.168.206.32@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790784618.401885:0:15022:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1790784618.401889:0:15022:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1790784617 00002000:00010000:0.0:1790784618.401891:0:15022:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1790784615 00002000:00010000:0.0:1790784618.401893:0:15022:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1790784618 -> 1790784617 00002000:00010000:0.0:1790784618.401895:0:15022:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1790784618.401941:0:15022:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4259360-45b3-4521-b0f8-25fb9487baea+9:2352:x1877773344962304:12345-192.168.206.32@tcp:2:lhsmtool_posix.0 Request processed in 242us (458us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1790784618.401949:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 17 00000100:00100000:1.0:1790784618.402060:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d220e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14322:1877773359620224:192.168.206.32@tcp:105: 00010000:00010000:1.0:1790784618.402082:0:14322:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790784618.402103:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f497480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4259360-45b3-4521-b0f8-25fb9487baea+8:2352:x1877773344962176:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 5838us (6390us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784618.402110:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 14 00000100:00100000:3.0:1790784618.405576:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784618.405724:0:15020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344962432 00000100:00100000:2.0:1790784618.405733:0:15020:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344962432 00000100:00100000:2.0:1790784618.405788:0:15020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 18 00000100:00100000:2.0:1790784618.405798:0:15020:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4259360-45b3-4521-b0f8-25fb9487baea+8:2352:x1877773344962432:12345-192.168.206.32@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1790784618.405846:0:15020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009cb92356/0x2c3a1e2a079d4d6e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.405884:0:15020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d4d67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.32@tcp remote: 0x394e0d883813551c expref: 8 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.405892:0:15020:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790784618.405897:0:15020:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790784618.405902:0:15020:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cb92356/0x2c3a1e2a079d4d6e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.405933:0:15020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d4d67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.32@tcp remote: 0x394e0d883813551c expref: 8 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.405947:0:15020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d4d67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d883813551c expref: 8 pid: 15020 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784618.405961:0:15020:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590685fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15020:1877773359620352:192.168.206.32@tcp:104: 00000100:00100000:2.0:1790784618.406050:0:15020:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592d92b600 going to sleep for 11 seconds 00000100:00100000:3.0:1790784618.410074:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784618.410293:0:16567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344962560 00000100:00100000:0.0:1790784618.410302:0:16567:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344962560 00010000:00010000:0.0:1790784618.410341:0:16567:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d4d67 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d883813551c expref: 9 pid: 15020 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784618.410430:0:16567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 15 00000100:00100000:0.0:1790784618.410440:0:16567:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f496d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4259360-45b3-4521-b0f8-25fb9487baea+9:2351:x1877773344962560:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790784618.410454:0:16567:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784618.410476:0:16567:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d4d67 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d883813551c expref: 9 pid: 15020 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.410491:0:16567:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d4d67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.32@tcp remote: 0x394e0d883813551c expref: 9 pid: 15020 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.410513:0:16567:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790784618.410517:0:16567:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790784618.410523:0:16567:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009cb92356/0x2c3a1e2a079d4d6e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.410546:0:16567:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cb92356/0x2c3a1e2a079d4d6e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.410565:0:16567:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790784618.410614:0:16567:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f496d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4259360-45b3-4521-b0f8-25fb9487baea+9:2351:x1877773344962560:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 176us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784618.410622:0:16567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 15 00010000:00010000:2.0:1790784618.411471:0:15020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000084f445a/0x2c3a1e2a079d4d67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.32@tcp remote: 0x394e0d883813551c expref: 8 pid: 15020 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784618.411489:0:15020:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590685fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15020:1877773359620352:192.168.206.32@tcp:104: 00010000:00010000:2.0:1790784618.411510:0:15020:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009cb92356/0x2c3a1e2a079d4d6e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.411520:0:15020:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009cb92356/0x2c3a1e2a079d4d6e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.411549:0:15020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cb92356/0x2c3a1e2a079d4d6e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.411576:0:15020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009cb92356/0x2c3a1e2a079d4d6e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.411584:0:15020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009cb92356/0x2c3a1e2a079d4d6e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.411592:0:15020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009cb92356/0x2c3a1e2a079d4d6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.411600:0:15020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030800 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:2.0:1790784618.411604:0:15020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009cb92356/0x2c3a1e2a079d4d6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.411613:0:15020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009cb92356/0x2c3a1e2a079d4d6e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.411627:0:15020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009cb92356/0x2c3a1e2a079d4d6e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.411634:0:15020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cb92356/0x2c3a1e2a079d4d6e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784618.411715:0:15020:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4259360-45b3-4521-b0f8-25fb9487baea+7:2352:x1877773344962432:12345-192.168.206.32@tcp:1:lhsmtool_posix.0 Request processed in 5918us (6147us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784618.411724:0:15020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 18 00000100:00100000:3.0:1790784618.416274:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784618.416655:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344962816 00000100:00100000:2.0:1790784618.416666:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344962816 00000100:00100000:2.0:1790784618.416721:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 60 00000100:00100000:2.0:1790784618.416731:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4259360-45b3-4521-b0f8-25fb9487baea+13:14518:x1877773344962816:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790784618.416813:0:14335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4d75 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.416830:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4d75 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.416841:0:14335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4d75 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.417271:0:14335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4d7c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.417284:0:14335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4d44 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135507 expref: 14 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.417292:0:14335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4d7c lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.417326:0:14335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4d44 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135507 expref: 14 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.417350:0:14335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4d44 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135507 expref: 14 pid: 14335 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790784618.417364:0:14335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590685fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14335:1877773359620480:192.168.206.32@tcp:104: 00000100:00100000:2.0:1790784618.417762:0:14335:0:(client.c:2716:ptlrpc_set_wait()) set ffff94592d92b600 going to sleep for 11 seconds 00000100:00100000:1.0:1790784618.420884:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:2.0:1790784618.420899:0:14335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590685fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14335:1877773359620480:192.168.206.32@tcp:104: 00010000:00010000:2.0:1790784618.420924:0:14335:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4d7c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784618.421055:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344962944 00000100:00100000:0.0:1790784618.421063:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344962944 00010000:00010000:0.0:1790784618.421097:0:14320:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4d44 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135507 expref: 15 pid: 14335 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784618.421156:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 16 00000100:00100000:0.0:1790784618.421166:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d220e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4259360-45b3-4521-b0f8-25fb9487baea+15:2351:x1877773344962944:12345-192.168.206.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790784618.421193:0:14320:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790784618.421200:0:14320:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4d44 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135507 expref: 15 pid: 14335 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.421212:0:14320:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4d44 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135507 expref: 15 pid: 14335 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.421237:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030000/0x2c3a1e2a079d4d44 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.32@tcp remote: 0x394e0d8838135507 expref: 15 pid: 14335 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.421252:0:14320:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff945903af2b00) 00010000:00010000:0.0:1790784618.421256:0:14320:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4d7c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.421265:0:14320:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4d7c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.421272:0:14320:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4d7c lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.421296:0:14320:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790784618.421340:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d220e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4259360-45b3-4521-b0f8-25fb9487baea+14:2351:x1877773344962944:12345-192.168.206.32@tcp:103:ldlm_bl.0 Request processed in 176us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784618.421347:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 16 00010000:00010000:2.0:1790784618.421792:0:14335:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4d7c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.421802:0:14335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4d7c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790784618.422983:0:14335:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1790784618.424040:0:14335:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:2.0:1790784618.424115:0:14335:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:2.0:1790784618.424624:0:14335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590685fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14335:1877773359620608:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790784618.424745:0:14335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784618.424785:0:14335:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459102b5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790784618.424949:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359620608 00000100:00100000:3.0:1790784618.424957:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359620608 00000100:00100000:3.0:1790784618.425060:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790784618.425069:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590685c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14335:x1877773359620608:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1790784618.425150:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590685c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14335:x1877773359620608:12345-0@lo:1000:mdt00_000.0 Request processed in 82us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784618.425158:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790784618.425244:0:14335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590685fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14335:1877773359620608:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1790784618.426200:0:14335:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:2.0:1790784618.426324:0:14335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94590685fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14335:1877773359620736:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790784618.426363:0:14335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790784618.426565:0:14335:0:(client.c:2716:ptlrpc_set_wait()) set ffff9459102b5480 going to sleep for 11 seconds 00000100:00100000:0.0:1790784618.426698:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906bea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359621120:0@lo:400:kworker.0 00000100:00100000:0.0:1790784618.426736:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784618.426774:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790784618.426780:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94593f497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359621248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790784618.426804:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790784618.426838:0:16214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359621120 00000100:00100000:0.0:1790784618.426844:0:16214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359621120 00000100:00100000:0.0:1790784618.426886:0:16214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790784618.426894:0:16214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906be8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359621120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790784618.426919:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359621248 00000100:00100000:3.0:1790784618.426923:0:15024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359621248 00000100:00100000:0.0:1790784618.426936:0:16214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906be8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1877773359621120:12345-0@lo:400:kworker.0 Request processed in 43us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784618.426943:0:16214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790784618.426948:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790784618.426954:0:15024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906be9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1877773359621248:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790784618.426971:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906bea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3279:1877773359621120:0@lo:400:kworker.0 00002000:00000024:3.0:1790784618.426975:0:15024:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790784618.427019:0:15024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906be9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1877773359621248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784618.427026:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790784618.427050:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94593f497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3279:1877773359621248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790784618.428008:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906be8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3281:1877773359620864:0@lo:400:kworker.0 00000100:00100000:1.0:1790784618.428117:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784618.428151:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906beb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1877773359621376:0@lo:400:kworker.0 00000100:00100000:1.0:1790784618.428532:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784618.428560:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790784618.428567:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff945906bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1877773359620992:0@lo:400:kworker.0 00000100:00100000:1.0:1790784618.428591:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790784618.428630:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359620864 00000100:00100000:1.0:1790784618.428637:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359620864 00000100:00100000:1.0:1790784618.428671:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1790784618.428678:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+19:3281:x1877773359620864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784618.428718:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ffae34-ce63-4427-b2f1-54f812a9cb4d+19:3281:x1877773359620864:12345-0@lo:400:kworker.0 Request processed in 41us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784618.428725:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1790784618.429276:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906be8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43ffae34-ce63-4427-b2f1-54f812a9cb4d:3281:1877773359620864:0@lo:400:kworker.0 00000100:00080000:1.0:1790784618.429299:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790784618.429323:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359621376 00000100:00100000:1.0:1790784618.429327:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359621376 00000100:00100000:1.0:1790784618.429363:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359620992 00000100:00100000:1.0:1790784618.429366:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359620992 00000100:00100000:1.0:1790784618.429672:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790784618.429691:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1877773359621376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790784618.429802:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906beb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3281:1877773359621376:0@lo:400:kworker.0 00000100:00100000:1.0:1790784618.429824:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1877773359621376:12345-0@lo:400:kworker.0 Request processed in 134us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784618.429831:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790784618.429846:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790784618.429853:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1877773359620992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790784618.429893:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1877773359620992:12345-0@lo:400:kworker.0 Request processed in 40us (1301us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784618.429899:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790784618.429918:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff945906bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3281:1877773359620992:0@lo:400:kworker.0 00000100:00100000:1.0:1790784618.430082:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773359620736 00000100:00100000:1.0:1790784618.430088:0:14341:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773359620736 00000100:00100000:1.0:1790784618.430124:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790784618.430131:0:14341:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590685d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14335:x1877773359620736:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1790784618.430631:0:14341:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590685d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14335:x1877773359620736:12345-0@lo:1000:mdt00_000.0 Request processed in 500us (4266us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1790784618.430638:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790784618.430672:0:14335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94590685fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14335:1877773359620736:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1790784618.430704:0:14335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4d7c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784618.430727:0:14335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4d7c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784618.430734:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4d7c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784618.430745:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe75c00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784618.430750:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4d7c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784618.430757:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4d7c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784618.430771:0:14335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff945903af2b00) 00010000:00010000:1.0:1790784618.430774:0:14335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790784618.430778:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4d7c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784618.430785:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe75c00/0x2c3a1e2a079d4d7c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784618.430812:0:14335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4cd4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784618.430828:0:14335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4cd4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784618.430834:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4cd4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784618.430839:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94593fe74400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:1.0:1790784618.430842:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4cd4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784618.430848:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4cd4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784618.430857:0:14335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff945903af2200) 00010000:00010000:1.0:1790784618.430859:0:14335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790784618.430865:0:14335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945909574e00/0x2c3a1e2a079d4cdb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354eb expref: 17 pid: 16214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784618.430875:0:14335:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945909574e00/0x2c3a1e2a079d4cdb lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354eb expref: 17 pid: 16214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784618.430885:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945909574e00/0x2c3a1e2a079d4cdb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354eb expref: 17 pid: 16214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784618.430935:0:14335:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff945909574e00/0x2c3a1e2a079d4cdb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d88381354eb expref: 17 pid: 16214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790784618.430948:0:14335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94592d221180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14335:1877773359621504:192.168.206.32@tcp:105: 00000100:00100000:1.0:1790784618.431104:0:14335:0:(client.c:2716:ptlrpc_set_wait()) set ffff945910ff8540 going to sleep for 11 seconds 00000100:00080000:3.0:1790784618.435593:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790784618.435841:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784618.435947:0:14335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94592d221180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14335:1877773359621504:192.168.206.32@tcp:105: 00010000:00010000:3.0:1790784618.435972:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4cd4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784618.435982:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94593fe74400/0x2c3a1e2a079d4cd4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784618.436019:0:14335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4d83 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784618.436034:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4d83 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784618.436045:0:14335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4d83 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784618.436055:0:14335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4d83 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784618.436064:0:14335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4d83 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784618.436084:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4d83 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784618.436089:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2f400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784618.436093:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4d83 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784618.436100:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4d83 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784618.436111:0:14335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff945903af2200) 00010000:00010000:3.0:1790784618.436113:0:14335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790784618.436117:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4d83 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784618.436122:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2f400/0x2c3a1e2a079d4d83 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784618.436131:0:14335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4d75 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784618.436136:0:14335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4d75 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784618.436141:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4d75 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784618.436146:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945900030e00 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:3.0:1790784618.436148:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4d75 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784618.436161:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4d75 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784618.436167:0:14335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff945903af2200) 00010000:00010000:3.0:1790784618.436169:0:14335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790784618.436171:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4d75 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784618.436176:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945900030e00/0x2c3a1e2a079d4d75 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14335 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790784618.436419:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4259360-45b3-4521-b0f8-25fb9487baea+17:14518:x1877773344962816:12345-192.168.206.32@tcp:57:lhsmtool_posix.0 Request processed in 19688us (20153us total) trans 8589934628 rc 0/0 00000100:00100000:3.0:1790784618.436429:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 60 00000020:00080000:3.0:1790784618.436435:0:14335:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1790784618.437126:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344963072 00000100:00100000:1.0:1790784618.437134:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344963072 00000100:00100000:3.0:1790784618.437366:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 12 00000100:00100000:3.0:1790784618.437394:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590685d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4259360-45b3-4521-b0f8-25fb9487baea+17:14517:x1877773344963072:12345-192.168.206.32@tcp:49:bash.0 00000100:00100000:3.0:1790784618.437501:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590685d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4259360-45b3-4521-b0f8-25fb9487baea+17:14517:x1877773344963072:12345-192.168.206.32@tcp:49:bash.0 Request processed in 126us (1661us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784618.437509:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 12 00000100:00100000:1.0:1790784618.439862:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784618.439896:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784618.440731:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344963328 00000100:00100000:3.0:1790784618.440741:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344963328 00000100:00100000:3.0:1790784618.440792:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 13 00000100:00100000:0.0:1790784618.440802:0:14338:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:3.0:1790784618.440804:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4259360-45b3-4521-b0f8-25fb9487baea+17:14518:x1877773344963328:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790784618.440810:0:14338:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:0.0:1790784618.441435:0:15021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344963456 00000100:00100000:0.0:1790784618.441441:0:15021:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344963456 00000100:00100000:0.0:1790784618.441487:0:15021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 19 00000100:00100000:0.0:1790784618.441495:0:15021:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4259360-45b3-4521-b0f8-25fb9487baea+7:14517:x1877773344963456:12345-192.168.206.32@tcp:101:bash.0 00010000:00010000:0.0:1790784618.441506:0:15021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790784618.441524:0:15021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df311a7d/0x2c3a1e2a079d4d8a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d8838135523 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790784618.441548:0:15021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6abd3469, atime: 0x6abd3467, ctime: 0x6abd3469, blocks: 0x1 00010000:00010000:0.0:1790784618.441566:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1790784618.441570:0:15021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790784618.441587:0:15021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df311a7d/0x2c3a1e2a079d4d8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135523 expref: 8 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.441604:0:15021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000df311a7d/0x2c3a1e2a079d4d8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d8838135523 expref: 8 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.441616:0:15021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945909575400, rc 0) 00000100:00100000:0.0:1790784618.441669:0:15021:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4259360-45b3-4521-b0f8-25fb9487baea+8:14517:x1877773344963456:12345-192.168.206.32@tcp:101:bash.0 Request processed in 174us (1772us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784618.441675:0:15021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 19 00000040:00080000:2.0:1790784618.442240:0:14368:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790784618.442246:0:14368:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790784618.442289:0:14368:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1790784618.442295:0:14368:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000004:00080000:3.0:1790784618.442341:0:14339:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1790784618.442474:0:14339:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:3.0:1790784618.442524:0:14339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e000/0x2c3a1e2a079d4d91 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784618.442657:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e000/0x2c3a1e2a079d4d91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784618.442670:0:14339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e000/0x2c3a1e2a079d4d91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784618.442679:0:14339:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e000/0x2c3a1e2a079d4d91 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784618.442684:0:14339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e000/0x2c3a1e2a079d4d91 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784618.442691:0:14339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e000/0x2c3a1e2a079d4d91 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790784618.442746:0:14339:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790784618.442819:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4259360-45b3-4521-b0f8-25fb9487baea+19:14518:x1877773344963328:12345-192.168.206.32@tcp:35:lhsmtool_posix.0 Request processed in 2016us (2963us total) trans 8589934630 rc 0/0 00000100:00100000:3.0:1790784618.442828:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 13 00000020:00080000:3.0:1790784618.442901:0:14339:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790784618.443472:0:14323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790784618.443480:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e000/0x2c3a1e2a079d4d91 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.443489:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945802d2e000 already unused, calling callback (ffffffffc15f88b0) 00010000:00010000:2.0:1790784618.443492:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e000/0x2c3a1e2a079d4d91 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.443500:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e000/0x2c3a1e2a079d4d91 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.443513:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff945903af2b00) 00010000:00010000:2.0:1790784618.443516:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790784618.443521:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e000/0x2c3a1e2a079d4d91 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.443589:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945802d2e000/0x2c3a1e2a079d4d91 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790784618.443603:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784618.443605:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790784618.443607:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790784618.448976:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784618.449365:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344963712 00000100:00100000:1.0:1790784618.453825:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344963712 00000100:00100000:1.0:1790784618.454026:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 14 00000100:00100000:1.0:1790784618.454099:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590685f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4259360-45b3-4521-b0f8-25fb9487baea+19:14517:x1877773344963712:12345-192.168.206.32@tcp:35:bash.0 00000001:00080000:1.0:1790784618.454840:0:14338:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:1.0:1790784618.454931:0:14338:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:1.0:1790784618.455117:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590685f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4259360-45b3-4521-b0f8-25fb9487baea+22:14517:x1877773344963712:12345-192.168.206.32@tcp:35:bash.0 Request processed in 1018us (6145us total) trans 8589934633 rc 0/0 00000100:00100000:1.0:1790784618.456524:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 14 00000020:00080000:1.0:1790784618.456532:0:14338:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000001:00080000:3.0:1790784618.470295:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:3.0:1790784618.470309:0:7614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000100:00100000:3.0:1790784618.615266:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784618.616275:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344963968 00000100:00100000:1.0:1790784618.616287:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344963968 00000100:00100000:1.0:1790784618.616366:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 61 00000100:00100000:1.0:1790784618.616401:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4259360-45b3-4521-b0f8-25fb9487baea+22:14528:x1877773344963968:12345-192.168.206.32@tcp:101:lfs.0 00010000:00010000:1.0:1790784618.616425:0:14336:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790784618.616445:0:14336:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4d98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x394e0d883813552a expref: -99 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790784618.616701:0:14336:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790784618.616899:0:14336:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4d98 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813552a expref: 24 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784618.616913:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945903af2a00) 00010000:00010000:1.0:1790784618.616927:0:14336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790784618.616932:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94590955f000/0x2c3a1e2a079d4d98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.32@tcp remote: 0x394e0d883813552a expref: 24 pid: 14336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790784618.616945:0:14336:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94590955f000, rc 0) 00000100:00100000:1.0:1790784618.617015:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4259360-45b3-4521-b0f8-25fb9487baea+23:14528:x1877773344963968:12345-192.168.206.32@tcp:101:lfs.0 Request processed in 641us (1967us total) trans 8589934634 rc 301/301 00000100:00100000:1.0:1790784618.617023:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 61 00010000:00010000:2.0:1790784618.620035:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790784618.627702:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784618.630681:0:16214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344964096 00000100:00100000:0.0:1790784618.630694:0:16214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344964096 00000100:00100000:0.0:1790784618.631164:0:16214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 62 00000100:00100000:0.0:1790784618.631176:0:16214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94592d221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4259360-45b3-4521-b0f8-25fb9487baea+23:14528:x1877773344964096:12345-192.168.206.32@tcp:34:lfs.0 00010000:00010000:0.0:1790784618.631949:0:16214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945909575800/0x2c3a1e2a079d4da6 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.631967:0:16214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945909575800/0x2c3a1e2a079d4da6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.631979:0:16214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945909575800/0x2c3a1e2a079d4da6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.632007:0:16214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945909575000/0x2c3a1e2a079d4dad lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.632016:0:16214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945909575000/0x2c3a1e2a079d4dad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.632024:0:16214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945909575000/0x2c3a1e2a079d4dad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.633433:0:16214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945909574400/0x2c3a1e2a079d4db4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.633448:0:16214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945909574400/0x2c3a1e2a079d4db4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.633457:0:16214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945909574400/0x2c3a1e2a079d4db4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790784618.633504:0:16214:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945909574400/0x2c3a1e2a079d4db4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.633516:0:16214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945909575800/0x2c3a1e2a079d4da6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.633522:0:16214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945909575800/0x2c3a1e2a079d4da6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.635768:0:16214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945909575800/0x2c3a1e2a079d4da6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.635775:0:16214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945909575800 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784618.635779:0:16214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945909575800/0x2c3a1e2a079d4da6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.635788:0:16214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945909575800/0x2c3a1e2a079d4da6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.635804:0:16214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff94590345d900) 00010000:00010000:0.0:1790784618.635807:0:16214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784618.635813:0:16214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945909575800/0x2c3a1e2a079d4da6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.635844:0:16214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945909575800/0x2c3a1e2a079d4da6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.635864:0:16214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945909575000/0x2c3a1e2a079d4dad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.635870:0:16214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945909575000/0x2c3a1e2a079d4dad lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.635875:0:16214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945909575000/0x2c3a1e2a079d4dad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.635879:0:16214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945909575000 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784618.635882:0:16214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945909575000/0x2c3a1e2a079d4dad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.635887:0:16214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945909575000/0x2c3a1e2a079d4dad lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.635895:0:16214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff945903a23200) 00010000:00010000:0.0:1790784618.635897:0:16214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784618.635900:0:16214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945909575000/0x2c3a1e2a079d4dad lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.635905:0:16214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945909575000/0x2c3a1e2a079d4dad lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.635921:0:16214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945909574400/0x2c3a1e2a079d4db4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.635926:0:16214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945909574400/0x2c3a1e2a079d4db4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.635936:0:16214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945909574400/0x2c3a1e2a079d4db4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.635941:0:16214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff945909574400 already unused, calling callback (ffffffffc20204f0) 00010000:00010000:0.0:1790784618.635944:0:16214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945909574400/0x2c3a1e2a079d4db4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.635949:0:16214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945909574400/0x2c3a1e2a079d4db4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.635955:0:16214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff945903af2200) 00010000:00010000:0.0:1790784618.635957:0:16214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790784618.635960:0:16214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945909574400/0x2c3a1e2a079d4db4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790784618.635965:0:16214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945909574400/0x2c3a1e2a079d4db4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790784618.636074:0:16214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94592d221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4259360-45b3-4521-b0f8-25fb9487baea+23:14528:x1877773344964096:12345-192.168.206.32@tcp:34:lfs.0 Request processed in 4897us (8376us total) trans 0 rc 0/0 00000100:00100000:0.0:1790784618.636082:0:16214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 62 00000100:00100000:2.0:1790784618.640883:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784618.641104:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344964352 00000100:00100000:3.0:1790784618.641114:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344964352 00000100:00100000:3.0:1790784618.641168:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 15 00000100:00100000:3.0:1790784618.641186:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94590685d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4259360-45b3-4521-b0f8-25fb9487baea+23:14528:x1877773344964352:12345-192.168.206.32@tcp:35:lfs.0 00000100:00100000:3.0:1790784618.641419:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94590685d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4259360-45b3-4521-b0f8-25fb9487baea+24:14528:x1877773344964352:12345-192.168.206.32@tcp:35:lfs.0 Request processed in 234us (543us total) trans 8589934635 rc 0/0 00000100:00100000:3.0:1790784618.641439:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 15 00010000:00010000:1.0:1790784619.645706:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790784619.953160:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784619.953204:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:1.0:1790784619.953583:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344964480 00000100:00100000:1.0:1790784619.953594:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344964480 00000100:00100000:1.0:1790784619.953641:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 122 00000100:00100000:1.0:1790784619.953651:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94591dc77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9cd6e380-086e-4f8a-8222-c63218e0c889+13:2349:x1877773344964480:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:2.0:1790784619.954130:0:15020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344964736 00000100:00100000:2.0:1790784619.954135:0:15020:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344964736 00000100:00100000:2.0:1790784619.954179:0:15020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 18 00000100:00100000:2.0:1790784619.954187:0:15020:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4259360-45b3-4521-b0f8-25fb9487baea+5:2349:x1877773344964736:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784619.954610:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94591dc77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9cd6e380-086e-4f8a-8222-c63218e0c889+13:2349:x1877773344964480:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 958us (1456us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784619.954620:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 122 00000100:00080000:1.0:1790784619.960313:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790784619.961366:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784619.961445:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784619.961466:0:15022:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1790784619.961474:0:15022:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1790784619.961576:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784619.961593:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784619.961607:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:3.0:1790784619.961642:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344965248 00000100:00100000:3.0:1790784619.961650:0:15022:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344965248 00000100:00100000:3.0:1790784619.961689:0:15022:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1790784619.961694:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344964864 00000100:00100000:3.0:1790784619.961696:0:15022:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344964864 00000100:00100000:3.0:1790784619.961707:0:15022:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1790784619.961711:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344965120 00000100:00100000:3.0:1790784619.961713:0:15022:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344965120 00000100:00100000:3.0:1790784619.961726:0:15022:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1790784619.961734:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 19 00000100:00100000:3.0:1790784619.961742:0:15022:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26f7a80f-38df-4ba4-8176-3236c76f443f+5:2349:x1877773344965248:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1790784619.961812:0:15022:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26f7a80f-38df-4ba4-8176-3236c76f443f+5:2349:x1877773344965248:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 71us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784619.961820:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 19 00000100:00100000:3.0:1790784619.961834:0:15022:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1790784619.961840:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 20 00000100:00100000:3.0:1790784619.961845:0:15022:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4259360-45b3-4521-b0f8-25fb9487baea+6:2349:x1877773344964864:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1790784619.961866:0:15022:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4259360-45b3-4521-b0f8-25fb9487baea+6:2349:x1877773344964864:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 21us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784619.961884:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 20 00000100:00100000:3.0:1790784619.961895:0:15022:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1790784619.961900:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 21 00000100:00100000:3.0:1790784619.961905:0:15022:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26f7a80f-38df-4ba4-8176-3236c76f443f+5:2349:x1877773344965120:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:3.0:1790784619.961926:0:15022:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:26f7a80f-38df-4ba4-8176-3236c76f443f+5:2349:x1877773344965120:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 21us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1790784619.961932:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 21 00000100:00100000:1.0:1790784619.962816:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344964992 00000100:00100000:1.0:1790784619.962825:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344964992 00000100:00100000:1.0:1790784619.962920:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344964608 00000100:00100000:1.0:1790784619.962923:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344964608 00000100:00100000:1.0:1790784619.962949:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 28 00000100:00100000:1.0:1790784619.962956:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26f7a80f-38df-4ba4-8176-3236c76f443f+6:2349:x1877773344964992:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784619.963015:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26f7a80f-38df-4ba4-8176-3236c76f443f+6:2349:x1877773344964992:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 59us (1655us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784619.963033:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 28 00000100:00100000:1.0:1790784619.963057:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 29 00000100:00100000:1.0:1790784619.963065:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff94593f495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4259360-45b3-4521-b0f8-25fb9487baea+24:2349:x1877773344964608:12345-192.168.206.32@tcp:400:kworker.0 00000100:00100000:1.0:1790784619.963093:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4259360-45b3-4521-b0f8-25fb9487baea+24:2349:x1877773344964608:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 30us (1517us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784619.963098:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 29 00000100:00080000:1.0:1790784619.963242:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790784619.963247:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790784619.963249:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790784619.968465:0:15020:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff94593f494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4259360-45b3-4521-b0f8-25fb9487baea+5:2349:x1877773344964736:12345-192.168.206.32@tcp:400:kworker.0 Request processed in 14269us (15250us total) trans 0 rc 0/0 00000100:00100000:2.0:1790784619.968963:0:15020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 18 00000001:02000400:2.0:1790784620.221795:0:16610:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:2.0:1790784620.666688:0:14324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790784621.692274:0:14323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790784622.004454:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784622.004531:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.32@tcp (source: 12345-192.168.206.32@tcp) 00000100:00100000:0.0:1790784622.004572:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344965504 00000100:00100000:0.0:1790784622.004581:0:15022:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344965504 00000100:00100000:0.0:1790784622.004643:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 20 00000100:00100000:0.0:1790784622.004656:0:15022:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906bebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4259360-45b3-4521-b0f8-25fb9487baea+6:2351:x1877773344965504:12345-192.168.206.32@tcp:16:kworker.0 00000100:00100000:1.0:1790784622.004672:0:15025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877773344965376 00000100:00100000:1.0:1790784622.004686:0:15025:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877773344965376 00002000:00100000:1.0:1790784622.004743:0:15025:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff945906bea680 x1877773344965376/t0(0) o4->f4259360-45b3-4521-b0f8-25fb9487baea@192.168.206.32@tcp:133/0 lens 504/0 e 0 to 0 dl 1790784633 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00000100:00080000:2.0:1790784622.004754:0:14331:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00100000:1.0:1790784622.004756:0:15025:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff945906bea680 with x1877773344965376 ext(0->8) 00002000:00010000:1.0:1790784622.004763:0:15025:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945906bea680 00000100:00100000:0.0:1790784622.004785:0:15022:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906bebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4259360-45b3-4521-b0f8-25fb9487baea+7:2351:x1877773344965504:12345-192.168.206.32@tcp:16:kworker.0 Request processed in 130us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1790784622.004795:0:15025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.32@tcp, seq: 0 00000100:00100000:1.0:1790784622.004805:0:15025:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff945906bea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4259360-45b3-4521-b0f8-25fb9487baea+7:2351:x1877773344965376:12345-192.168.206.32@tcp:4:bash.0 00000100:00100000:0.0:1790784622.005250:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 20 00000100:00100000:1.0:1790784622.005357:0:15025:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff945906bea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4259360-45b3-4521-b0f8-25fb9487baea+9:2351:x1877773344965376:12345-192.168.206.32@tcp:4:bash.0 Request processed in 550us (910us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1790784622.005367:0:15025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.32@tcp, seq: 0 00002000:00100000:1.0:1790784622.005402:0:15025:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff945906bea680 x1877773344965376/t8589934598(0) o4->f4259360-45b3-4521-b0f8-25fb9487baea@192.168.206.32@tcp:133/0 lens 504/448 e 0 to 0 dl 1790784633 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1790784622.005414:0:15025:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff945906bea680 with x1877773344965376 ext(0->8) 00002000:00010000:1.0:1790784622.005419:0:15025:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945906bea680 Debug log: 29541 lines, 29541 kept, 0 dropped, 0 bad.